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DIFFICULTY RATINGS OF ADDITION FACTS AS RELATED 
TO LEARNING METHOD 


ESTHER J. SWENSON 
Ball State Teacher College 


Editor's Note: The comparative difficulty of learning seems to be at 
least, in part, a function of teaching method. The author presents data that 
t this thought in the lIcarning and teaching of arithmeti 


Too often in the field of education have the results of careful scientific 
research been ignored insofar as their application in practical teaching and 
ining situations is concerned. A notable exception is afforded by the use 
which has been made of research studies on the difficulty of learning so- 
lled arithmetic ‘‘facts’”. Writers of textbooks and courses of study as well 
lassroom teachers have used the results of such research to determine the 

ler in which the said ‘‘facts” should be presented, the assumption being 
that the optimum learning order should correspond to the “difficulty of 


irning’’ order determined by the research studies. Many a sales argument 
has been based upon this assumption. 

Of course, none of these difficulty studies has ever agreed too closely 
with any other. Such lack of agreement indicates a certain degree of unre- 

ability in the ratings derived from either or both of the studies being 
compared. Common practice has been either (1) to use a composite rating 

ised On two or more studies or (2) to use the ratings derived from that 
study which appealed to the user as being more dependable. 

Since most of the research on relative difficulty of arithmetic facts has 
been based on repetitive methods of learning, the question arises as to 
whether or not such results are valid when applied in learning situations 
not so definitely drill-centered. For example, can the order of difficulty of 
he addition facts as derived from the use of drill-type learning procedures 
be depended upon as being the correct order of difficulty for learning the 
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same facts by some other learning method 


was directed tov 


function of learning method? The study here rc 


securing a reply to this question. 


The study in question was a subsidiary investigati 


an extensive study? of forgetting and transfer of training, using the 


uterial for 332 


addition facts as the learning m 


vidual subjects participating 


experiment varied in 


130 months, in M. A. from 7 


nd in I. Q. from 7 


By a stratified randomization procedure, each second 


to one of three different instructional methods (designated as D, X, ar 


The near-equivalence of the three large method groups is indica 


the mean M. A.'s (D, 94.29; 
} 


) and the mean 
n (D, 24.52: 


was shown tha 


bers of addition facts known preceding instructic 


and G, 24.00). By analysis of variance i 


groups were not significantly different in either M 


A. or original know 


ition facts continued for a 


of the addition facts. Instruction on the ad 


of 15 weeks, with 25 minutes of instruction each school day in all gro 


is not to compare the relative 


Since the purpose of this arti 


the different instructional proces 


between method of learning and difficulty ratings of facts, the three le 


methods will not be described in detail. The D m 


GE 


thod was based, pre 


y, upon drill learning theory, with stress upon varied repetition 


tion facts in miscellaneous order. The facts were presented to this grou 


order of difficulty as found by combining the results of three ‘diff 


studies’. The G method was based upon the generalization or meat 


theory of learning arithmetic, with stress upon discovery of relations! 


among facts and organization 


Order of preseniation was de 


rep f the 
rn. Sw 1. Est ] Gener 
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\ ry r ft tudy has 
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Kn t, F. B., and Behrens 
j d the One Hus 
Thiele, C. L. T ) 


of those facts around number relations 


termined by a set of number generaliz 


ne Hundred Ada 


difhculty of the 100 
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is the order of difficulty 
l-grade children. I 
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| dy is to be found in the writer's doctoral d 
) tion and Organization as Factors in Transfer ana 
f Minnesota. Doctor's Thesis, 1941 
j also been published under the same title in 
of Science, pp. 248-255, 1942 
M. S., The Learning of the One ZZ 
4 Subtraction Combinations. New York, 1928 
j 1 of generalization to the learning of the ad 
: tacts. Teachers College Con utions to Education. No. 763, 1938 
Wheeler, Lester R., A comparative study of the Ei 
mbinatior Journal of Genetic ] hoioey, 54 12. I 
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around which facts were grouped (e.g., “adding 1", “adding 0’, adding 
near-doubles”, etc.). The X method was in intermediate met od designed 
to correspond as nearly as possible to ‘common practice” in the teaching of 
arithmetic. There was much emphasis upon drill, but it was accompanied 
by concrete presentation of each addition fact and the facts were presented 
n an organized pattern, that of “size of-sum”’. 

Timed tests were given at the beginning and end of the experiment. 
Combinations were presented by a flash-card technique at the rate of one 


ry 4 seconds. A brief pause was allowed after every tenth fact. Answers 


only were written by the children on answer sheets. The numbers of cor- 
t, omitted, and wrong responses to cach test item were tabulated. The 
ulated data were handled separately for each method, and percentages of 
lifficulty (number right -- number responding) computed for each fact. 


Such percentage ratings were made for each fact within each method 


group. The 100 facts were assigned ranks from 1 (easiest) to 100 (hardest). 
For instance, the dithculty ranks of | 1 on the initial test were: for the X 


group, 2; for the D group, 1; and for the G group, 1. As another example, 
> had these ranks on the initial test: X, 89; D, 87; and G, 88. Coefh- 
ents of correlation were computed to indicate the relationship between 
lifficulty ranks within the different method groups—that 1s, between X and 
D ratings, between D and G ratings, and between X and G ratings. The 
formula used for these correlations was: 


(Sum X) (Sum Y) 
Sum XY - = 


(Sum X)? (Sum Y) 


Table 1 presents the correlation coefficients for both the initial and final 
tests. The ¢ for the relation between X and D ratings on the first test was 
969: for the relation between G and X, .971; and for the relation between 
G and D, .967. These highly significant r’s would seem to indicate very high 
agreement in difficulty ratings from one group to another at the beginning 
of the experiment, before the children had had any definite instruction on 
the addition facts. 

The question to be answered was whether the different instructional 
procedures would result in appreciable differences in difficulty ratings of the 
addition facts. To answer that question, r’s were computed for ranks on the 
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final test in the same manner as for the initial test. The r for X and I 


) 


910, for G and X, .88; and for G and D, .934 (see Table 1). Thes 


like those on the first test, are highly significant and indicate a close 
tionship between difficulty ratings at the end of the study in spite of th 
of different methods of instruction in the different groups 


TABLE I 


IFICANCE ¢ D ( Cr \ or Du RA cs | 
CTl BY | M 
Diff 
( ured diff 
) > ‘ 481 | 1 1 14 3. 82 
) ’ l 101 | 
Gi 71 2.1 733 101 143 5. 11 
Gil 04 1 2.47 


However, the fact that there remains a highly significant relation 


between the difficulty ratings in different method groups at the end of 
y does not answer the question as to whether or not a significant di 


ence in relationships occurred during the learning period. To find this 
the significance of the difference between the r determined at the begins 
of the study and the corresponding r determined at the end of the 
must be considered. The significance of the differences between the in 
test r’s and the final test r’s was determined by the use of the follow 
formulas 


++ 


t S.E.,’ + S.E.. 
SI t 
] 
S.E.s zr — >| log. (1 + r) — log. (1 r) 
VN 5 
Table 1 makes it quite pparent that the different methods of instr 


tion (including their different orders of presentation of number facts) w 


tabl 


: es of z- in Treloar. Element 
and Sons. 1939, p. 244. 


valu of 


Statistical Reasonin g 


¥ 
a i= Initial test rat F = Final test ratings 
| 
were read from Treloar ment 
New York: John Wiley 
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mpanied by a significant change in correlation coefficients. For instance, 


ference between X and D r on the first test and the X and D r on the 

t was highly significant The t-value of 3.82 reaches the | 
litv. The difference between initial and final 

tween G and X ratings was even beyond the .00 | of | 

(t 5.11). The G and D difficulty correlations for initial ana ht 


ilso significantly different (t 2.47) at the 


In every case the significant difference between rs was cat sed by a 


n the size of the correlation coefficient during instruction. It seems 


lifferent chi me hods did re It h chan n relative 

vy of addition facts trom o ethod { r to « e signif t 
in the inter-method d y ns 

An inspection of the data fro his ex] leads one to th n 

tn l { nin the 1 ) ] on I ts | \ he 1s \ \ hiefly 

legree of empha Is upon nization 1d generalization seceme 1 to 

significantly lower « rrelations of inter-method difficulty ratings 

1e addition facts. A logical imp! ion that res h workers in the 


Research which aims toward establishin he difficulty of hr 
1 processes should prol ably do so in terms of a clearly defined teach 


nd learning method. It may well be that many of the laboratory diffi 
tudies are not so widely applicable inder varied classroom situations 

been supposed. If such studies were repeated under other conditions 
1 those under which they were originally done, and results compared, 
e different results might emerge. The impli ation of the present study 
comparative difficulty of addition facts may be to some extent a function 


earning method is worthy ot further investigation 
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THE RELATIONSHIP OF READING SKILLS TO THE ABILITY 
TO SOLVE ARITHMETIC PROBLEMS 


JOHN P. TREACY 
Graduate School, Marquette University 
Editor's Note: Reading has been shown to be a function of achievement 
in the content subjects. The author explores this relationship in the teaching 
of arithmetic 
THE PROBLEM 
rHE purpose of this study was to determine the relationship of certa 
reading skills to ability to solve verbal problems in arithmetic. Genera 
questions which grew out of this problem are: 
1. Is general reading level significantly related to ability to soly 
problems in arithmeti 
2. Are certain specific reading skills significantly related to ability 
solve problems in arithmetic? 


DEFINITION OF TERMS 
The interpretation of “reading skills” is limited in this study to t 
abilities measured by 15 specific tests. ‘Problems’ is used here to denot 
verbal arithmetic problems which involve the use of computations. ‘‘Proble: 
solving ability” refers to the traits measured by two tests of arithmetic rea 
soning. “Relationship” is interpreted as concomitant occurrence, not as causa 


relationship. 
THE PLACE OF PROBLEM SOLVING IN ARITHMETIC 


According to an older view, the ultimate objective of arithmetic inst: 
tion was the solution of practical problems of life.t Recently broader and 
deeper values are claimed for arithmetic in general, and for problem solving 
in particular. Arithmetic instruction has now come to be thought of 
terms of its computational, informational, sociological, and psychologic: 
functions.* Because of this shift in objectives, arithmetic is considered 
social as well as a practical subject.’ Ability to solve practical problems is 
still among arithmetic objectives, but it is only one objective among many 

PROBLEM SOLVING IN ARITHMETIC AND IN LIFE 


Dewey identifies a problem with any situation involving perplexity, 
confusion or doubt; he thinks of a problem as containing elements which 
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nexpected, queer, strange, funny, Of disconcerting. To Dewey a problem 
the starting point of reflective thinking.* 

Problems in arithmetic textbooks and in tests sometimes are not really 

5 at all in this sense, I ut are n erely pra tice exercises [ofr operations 

h being habituated. They often do not involve the evaluative and 

tal elements which characterize the situations in which life problems 

found.® The newer! textbooks do tend to group problems ibout significant 
e-like iations such as installment buying, insurance, and the like 

life situations. The 


m solving is a typical form of thinking tn 


Pro 
reoaral 

roaches to problem solving are very similar, regardless of 

‘ 


rience happens to be. Because of this, solving pt 


an be a positive or a negative force in helping p pils in the solution 
other lite problems. Insofar as factors which influence th solving of 
problems in arithmetic are known and utilized intelliger tly in teach 
practice the characteristic ele 


pils’ opportunities to sense and to | 
data, appr Xiation 


in problem solving (formulation, solution, 


\n, operation, proof, and symbolism) are thereby enhanced. And, cor 
ndingly, insofar as pupils are deprived of experience in problem solving 
ilitie 


interference of such factors as reading weaknesses, their possi! 


tering these elements are thereby hindered. 


ASLL 


RESEARCH ON FACTORS RELATED TO SUCCESS IN PROBLEM SOLVING 


Factors which have been studied in attempts to analyze difficulties in 
I solving include: size of numbers; physical defects: terms used, es 
ially those involving quantitative relations; sex of pupils ; methods used; 
ystematical arrangement of work; nature of supervision ; general vocabulary 
tables of weights and measures; the habit ol 

ind of exper 


p of essential facts, 1.¢., 
results; presence of non essential elements; backgrou 


checking 
preferences; energy, cfort; command ol 


reading level; individual | 2) 
and ability to do reflective thinking 


based pon 


vature, Many 


ence: 
fundamentals; general intelligence; 
Some of the studies on factors in problem solving were 


jective analyses which could contribute little of a definite 1 


lies were based on correlations, with no attempt made to control 


factors while measuring the effects of others Most studies « 


lid not show 
her or not the correlation found could have been due to chance, o1 


of correlations were statistically 


whet 


whether or not apparent differences in sizes 
significant. In most of the studies using a correlation technique, positive 
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correlations were interpreted as representing a causal relationship, alth 
there was no follow up study to check on this assumption. A num! 

studies of the factors related to problem solving included reading an 
a number of other items. In most of these instances reading 


and was not broken down into its omponent skills. Because of thes« 


was not defi 


other limitations of existing research on factors related to problem sols 
broad generalizations regarding related factors are hardly in order 
research which has been conducted may justify certain tentative conclus 

1. General intelligence, vocabulary, use of quantitative terms 
computational ability are positively related to problem solving 

2. Systematic training in a definite procedure for attacking prob! 
results in higher scores on problem tests. The specific procedure whi 
ctive is not clear, and may be conditioned by such factors 
zeal of the teacher, the age of the pupils, and by similar conditions 


3. Studies of the relationship of reading to prol lem solving 


< 


possible explanation of these disc repan 
that reading was not interpreted 
studies. If different reading skills are not equally important for si 


problem solving, and if the reading skills measured varied among tl 


measured in the same way in the \ 


it was to be expected that there would be discrepancies in the find 


revarding the relationship of reading to problem solving. The findings o 
present study may help to explain certain findings which have been rep 
The weight of the evidence indicates that there is a positive relatio: 


between reading as it has been measured and problem solving ability 
PROBLEM SOLVING AND SPECIFIC READING SKILLS 
The need for studies of the relationship of specific reading sk 
problem solving ability was anticipated a number of times by Monr 
Englehart.® Illustrations of this are: 


Reading ability seems to be an important factor in the ability to resp 
) 


to verbal problems, but the precise nature of its function has not | 
ascertained.? 

There is also need for more information about the function of read 
in pupil responses to verbal problems and the relation of the form 
vocabulary of problem statements to these responses," 


Wilson recently has expressed even more clearly the nature of 
problem 
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There is an accumulation of evidence which indica 


mrobiems Calis for some 
nce with the vocabulary an 


1as received only limited attentio 


Fichteen items of information were 


r 


Milwaukee junior high schools throug 


School Achievement Te 


ing Mental Test, B 


lype B, Prediction of O ) 
[ype C, Understanding of Dit 
Analytical Scales of Attains 
Quantitative Relationshy 
Arithmetic Vocabulary 
Diagnostic Examination of Silent R 
Rate of Comprehension 


> 


Perception of Relationships 
Vocabulary in Context 
Vocabulary, Isolated Word 
General Information 

Grasp of General Thought 
Retention of Details 
Interpretation of Content 
Integration of Dispersed Ideas 
Drawing of Inferences 
General Reading Level 


These tests were administered under 


ng the period from May june 8, 


nvolving approximately 375 munutes, we 


al Scales of Attainmen Pro 


ny 


s that the rea 


n that } 
h 
ot 24 ] 
ing the [to 


q 
ist 
} 
unta conventions em 
nts 
The que tion of the nature of the reading mstruct Id | afl. 
and further eded 
fore any conclusion can be stated.'* 
PROCEDURES IN PRESENT STUDY Bea 
Ilected for eac ip! 
Anal yt: ems 
Public sts: Arithmetic Re. ait 
pal 
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yeading ability. 
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ests were scored through the cooperation of the W.P.A. Testing Proje 


the Milwaukee Public Schools. 

The criterion for ability in problem solving ability was the aver 
performance on two standardized tests. Since the units of measurement 
these two tests were not equivalent, the raw scores could not be averag 
In order to make it possible to combine the measures of problem sol 
ability, the raw scores were turned into T-scores.** In the resulting ac 

ores, the unit of measurement is one-tenth of a standard deviatio: 
to avoid certain statistical complications, the raw scores of read 


tests were also turned into T-Scores 


The reliability of each of these tests for the group measured was det 


mined by selecting at random'® 50 test papers and applying the Hoy 
method of estimating reliability coefficients. Detailed results are reported 
lable I. The reliability coefficients found for the reading tests varied f: 
i7 in Quantitative Relationships to .97 in Vocabulary, Isolated Wor 
the median reliability for the reading tests was .78. All coefficients exc 
one were above .70, eight were above .80, and two were above .90. TI 
4 coefliicients may be an underestimate of the actual reliability Other eviden 
f of reliability and validity are reported in the respective test manuals 

In order to combine the 7B groups from the two schools, it had to 
shown that in problem solving they were homogeneous both as to m 
and as to variability. Homogeneity of variability was determined by divid 
the larger variance by the smaller variance and applying Snedecor’s Ta 
of “F’'** values. Homogeneity of means was determined by the “t’’ test 
significance 

The 80 pupils having the highest combined T-Score on the tests 
rt problem solving were designated as “good achievers”, and the 80 pup! 
having the lowest combined T-Score were designated as “poor achiever 
Through use of the “F” test and of the “'t’’ test it was demonstrated 


(1) that the good achievers in the two classes were homogeneous as 


. mean achievement and as to variability in problem solving; (2) that 
4 poor achievers in the two groups were homogeneous as to mean achie\ 
: ment and as to variability in problem solving; (3) and that the goo 
| achievers as to group and the poor achievers as a group were homogeneot 


as to variability but heterogeneous as to mean achievement in _problet 


solving 


‘ 
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RELATIONSH OF READING SKILLS l 
TABLE I 
ip ( rAIN VALUES USED IN COMPUTING RELIABILITY FOR ONE TEST 
OF INTELLIGENCE, Two TESTS OF PROBLEM SOLVING, AND 


FOURTEEN READING SKILLS 


k I S, rit 
80) 2614 140674 100032 86 
2 11621 22806 R7 
is ( 1409 41733 3323 
a I t 10 ( 92 17774 2839 4 
et \ * 10 ‘) 1138 26982 39566 0 
i) 24 ) R66 15648 37502 
B 
‘ g D 24 ( 81 14005 31579 8 
( 
251 82967 4769 
4) 1258 83801 46616 
37 1198 32967 4769 9 
‘ 1136 27698 S97RR 
20 ) 46! 18118 74 
2 68 17202 i4 
) 7 18659 70 
) 3* 0 7 18365 74 
Inf * 2? 0 42 TTF 18408 75 
) ) G12 181420 2 92 
° Scales of Attainment 
Ach nent Tests 
Silent I ling At 
the Rate of Comprehension Test could not be measured because this test was a 
ed with the summary charts to the cooperating act ole 
[he good and poor achievers were then compared on each of 15 read 


means of the ‘'t’’ test of significance, This technique, howeve: 
serious limitation, for it’ left uncontrolled the effects of chronological 
1 of mental age. Chronological age was found to correlate 299 
th problem solving ability, and mental age correlated .758 with this abil 
Both of these correlations were found to be significant at the one per 


vel by use of Fisher's formula for the significance of correlations 


1¢ Johnson—Neyman technique of statistical analysis** was used, with 
ntal age and chronological age statistically controlled. For both the “t 
st and the Johnson-Neyman technique the null hypothesis tested was that 
difference in means in the various reading skills between good and poor 
hievers in problem solving is zero. The facts of observation were then 


illowed to refute this hypothesis 


FINDINGS 


1. Application of the “'t’’ test of significance showed good achievers in 
oblem solving to be superior to poor achievers in problem solving at the 


one per cent level of significance in all of the reading skills studied and in 


_ 
‘A 
} 
i 
tee 
cnt 
i 


TEA 


JOURNAL OF EDUCATIONAL RESEARCH  [Vol. 38, N 


g Th va 1 from 3.19 to 12.59 
e of 8.48. Poor achievers were older chronologically than 
he five nt level of significanc 
2 \ parison of good and chievers in prol lem solvit 
irithmet mn 15 reading skills by means of the Johnson-Neyman tech: 
with mental a and chronological age statistically ntrolled, resulted 
\ nndings 
(a) Good achievers were found to be better an poor a nievers a 
one per cent level of significat in Quantitative Relationships, Perce; 
of Relationships, Vocabulary in Context, and Integration of Dispersed ] 
(b) Good achievers were found to be better than poor achiev 
1e five per cent level of significance in Arithmetic Vocabulary, Vocal 


(Isolated Words), Retention of Clearly Stated Details, Drawing of | 
ences from Context, and Reading Level. 
(c) No significant differences were found between good and 
ichievers in the Prediction of Outcomes, Understanding of Precise D 
ns, Rate of Comprehension, General Information, Grasp of Cer 
Thought, and Interpretation ot Content. 
(d) In each instance in which a significant difference in reading 
was found between good and poor a hievers in problem solving by m 
of the Johnson—N an techn que, the region of significance was restt 


( 
Ull 


ly a definite part of the population. The mental ages varied from 


months to i months, the entire scale used in the present analysis. 7 


chronological age varied from 128 months to 168 months. Two ot 
regions of significance were in the form of a hyperbola, seven in the | 


of an ellipse. The detailed findings are repc ed in Table II. 


EDUCATIONAL IMPLICATIONS OF FINDINGS 


1. The results of this study indicate that in studying the causal re 


tionships between reading and problem solving in arithmetic, and in plann 
procedures for helping pupils through reading instruction to improve tl 
ability in problem solving, re iding should be regarded as a composite 


specific skills rather than as a generalized ability. The list of reading ski 
which should be considered, in addition to the ones studied here, 1s 


problem for further research. 


abe: 
4 | 
4 
| 


RELATIONSHIP OF READING SKILLS 


MAR Fi ) ( lo oO NI MA ANA 
Read 
\ \ ‘ 
4 4 
Quant I I 
Perception of } 
Vocabulary ( } 
Int I I 
A rithme 
Vocabulary, Is ated V 3 118 
Clearly Stated Deta 142- 1$ 128-143 
Drawing Inferences ‘ 
Reading Level 
f i g (ut os 
Dire 
Rate { Cor prehens 
General Information 
Central Thought 
Ir notation of ¢ 
*] ates that the regior Big ince is I 
parentheses repress ig r £ ibl 
res¢ ple 
le hers of arithmetic sho ild conside he t iding skills which ar 
ficantly related to success in this subject, especially in their diagnost 
| remedial work. Tests covering reading skills which are related to prob 
ing might well precede some exercises in problem solving. Remedial 
. teaching should follow where weaknesses in reading skills related to succes 


problem solving are discovered 

When carrying on diagnostic and remedial teaching in reading, in 
attempt to improve problem solving in arithmetic, attention should | 
iven to the mental ages and the chronological ages for which the relation 


hip between reading skills and problem solving has been found significant 
i. Four of the reading skills on which good and poor achievers in 
problem solving differed significantly were associated in one way or another 
th vocabulary (Quantitative Relationships; Vocabulary in Context: Vo 
bulary, Isolated Words; and Arithmetic Vocabulary). This fact s 
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the need for stressing the meaning of terms, general and mathematica! 


an approach to improving pupils’ ability in problem solving 


5. Three of the reading skills on which good and poor achiev 


differed significantly (Perception of Relationships; Integration of Dispe: 


Ideas: and Drawing Inferences from Content) require that the pupil 


fully associate, immediately and remotely, the elements of the reading 


rial which he reads. This finding may be one explanation of the fact 


Rate of Comprehension was not found to be a significant factor in prol 


solving. It also suggests that help given to a pupil which enriches 
meanings of what he reads may have a beneficial effect on his pr 
solving ability 

6. Good and poor achievers differed significantly on Retenti 


Clearly Stated Details. This suggests the possibility that pupils ma 


troubled in problem solving by inability to retain significant facts as wel 


by inability to understand what is read, and that instruction sho 
designed accordingly. 

In the review of the literature regarding the relationship of rea 
and problem solving in arithmetic some discrepancies in findings 
found. This situation may be explained in part by the fact that some 
were based upon measures of certain reading skills, and some studi 
other reading skills. In the light of the present findings, such a discre} 
would have been expected. For example, some of the studies emp! 


reading tests in which rate of comprehension was an element; the p: 


study did not find that skill to be significant. Other studies used tests 


general reading level; the present study found reading level to be signifi 


only at the five per cent level. Still other studies reported used reading t 


which measure reading skills of unequal significance for success in prol 


solving These facts « frm an earlier c clusion, that rese. arch on the 


tionships of reading pr blk ms leing in arithmetic should be in ter 


of general reading ability. 


CAUTIONS REGARDING THE INTERPRETATION OF RESULTS 


Certain limitations must be recognized when interpreting the res 


of this study: (1) “Relationship” as used here refers only to concomit 


occurrence; it does not necessarily imply causal relationship. (2) “Ment 


Age,” “problem solving ability,” and “reading skills” are limited here 


the traits measured by the tests used in ascertaining them. (3) In some 


| 

} 

( 


RELATIONSHIP OF READING SKILLS 


analyses the expression “significant at the five per cent level” is used 
ray be questionable whether or not differences at the five per cent | 


ild be considered as significant 


SOME SUGGESTED PROBLEMS FOR FURTHER RESEARCH 


study of the relationship of other reading skills to ability to sol 
lems in arithmetic 


Studies similar to the present one, but using samples from different 


3. Controlled studies of the influence of improvement in certain rea 
kills on progress in problem solving in arithmetic 
i. Studies of the inter-relationships of various skills which are meas 
by reading tests 
5. Studies of the reading skills needed to solve arithmetic problet 
h occur in the lives of adults 
A comparison of the reading skills needed to solve problems in the 
and in the newer arithmetic textbooks 
7. Studies similar to the present one with different combinations of 


tors, such as mental age and ability in fundamental operations, controlled 
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THE EFFECT OF INSTRUCTION IN: MATHEMATICA 
VOCABULARY UPON PROBLEM SOLVING 
IN ARITHMETIC: 


HARRY C. JOHNSON 


State Teachers College at Buffal 


40 


Editor's Note: Much progress has been made in ferreting out 


ana 
iking known difficulties in learning arithmetic. The author adds to this 


terature by indicating the importance of vocabulary in arithmetical 


INTRODUCTION 


DIAGNOSTIC studies in the field of problem solving in arithmetic have 
vealed numerous possible causes of difficulty in this important area of 
irning. Many experimental studies have already been made to determin: 

he values of certain types of remedial measures toward the improvement 
the problem solving ability among elementary school children. 

The experiment summarized in this article limits itself to one narrow 
jase Of the general difficulty that problem solving presents. Specifically, 

question to be considered is, ‘“What effect does the learning of mathe 
matical vocabulary have upon the solution of numerical problems in which 
words play an important part?” 


Whether or not there is a relation between the knowledge of general 
xabulary and problem solving ability in arithmetic was not the concern 


this present experiment. Evidence would not be hard to obtain, to show 


that there is a considerable relationship between knowledge of specific mathe 


itical terms and the solution of problems involving those terms. For ex 
umple, a child would not be apt to solve correctly a problem calling for th« 
area of a rectangle, unless he knew the meaning of “area”, and what proces 
to use in finding it. Similarly, problems using words such as discount, net 
proceeds, profit, ratio or average could not be attacked intelligently 


unle 
the meanings of these words were well understood. 


It is, howgver, the purpose of this study to determine whether smprove 
i im specific mathematical vocabulary leads to an 


mer improvement in the 
solution of problems which involve the use of these specific mathematical 


rms. 


* Abstract of a doctor's dissertation written under the 
Brueckner, University of Minnesota 
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lo be able to demonstrate statistically the apparently obvious fact 


instruction in vocabulary leads to an improvement in the understand 


aM the meanings of these words, is certainly not to be minimized. To | 
rt) to show, further, that such learning is also accompanied by impr \ 
in the solution of problems based upon these words is of much 
significance. Such evidence should tend to lay greater emphasis 
icquisition of specific vocabulary in mathematics, particularly, and 
“(a in other fields where technical vocabularies exist 
PROCEDURE 
y Homogeneity of the Schools. This experiment, conducted 
1941-42 in three junior high schools of Niagara Falls, New Yor 
ae volved 898 pupils in 28 seventh grade classes. These children were ¢ . 
ie by a group of 15 teachers, with varying degrees of training and expe: 
In order to justify the combining of the populations from the 
schools into one large group, it was necessary to demonstrate that 
schools were statistically homogeneous. The following tests were u 
Welch-Nayer test? * for the homogeneity of variability, and the a: 
- ) ) 
of variance test‘ for the homogeneity of means. It was found tl 
schools were homogeneous in these two respects, on each of the fol 
measures: 
" 1. Chronological age 
2. Mental Age. (Henmon—Nelson Intelligence Test). . 
3. Reading ability. (Gates Reading Test-Ability to Read to 
fal Details) 
4. Arithmetic problem solving and arithmetic vocabulary (An 
Scales of Attainment). 
5. Knowledge of arithmetic vocabulary studied prior to the begir 
= of the experiment.° 
| After it was demonstrated that the three schools came from the 
. veneral population, the various classes were assigned to the experi: 
*B. L. Welch, “Note on an Extension of the L, Test,” Statistical Re 
Memoirs, I (June, 1936), 52-56. 
*p P. N. Nayer, “An Investigation into the Applications of Neymar 
Pearson's L, Test, with Percentage Limits,” Statistical Research Memoirs, 1 (| 
ld 1936), 38 52 
; *E. F. Lindquist, Statistical A ilysis in Educational Research. New York: H 
1 Mifflin Company, pp. ¢ 5 
5 ® Based upon results from a 40 point objective test of the multiple choice 
‘ constructed by the writer 
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ntrol groups. Ordinarily, this should be done in a random manner 
wever, since ability grouping was practiced in the school system employed 
this experiment, the segregation of the classes into the two groups was 
mplished in each school by alternating the classes from high ability 
w ability. 
The statistical procedure, chosen by the writer for the analysis of the 
lid not require an individual-for-individual matching of the pupils 
the experimental and control groups. Recently, techniques* have been 
ped which make it possible to adjust for mean differences that exis‘ 
en groups with respect to basic matching characters. If however, it can 
own that the experimental and control groups are equivalent at the 
nning of the experiment, the analysis of the data can be carried out 
satisfactorily through the application of less rigorous statistical 
nique Se 
Equivalence of the Experimental and Control Groups.—A very com 
nsive study was made of the experimental and control groups to 
mine whether or not they were comparable at the beginning of 
experiment. The writer felt that the most important criteria to be con 
red were those knowledges and skills in the field of arithmetic which 
most closely associated with the specific problem to be investigated 
test chosen for this purpose was the Analytical Scales of Attainment,’ 
h provides measures of ability in four phases of arithmetic: 
1. Understanding of quantitative relationships. 
Ability to solve arithmetical problems. 
3. Understanding of mathematical vocabulary. 
i. Ability in the fundamental operations 
All cases for whom complete data were not available on these tests 
discarded from the study. This left 316 pupils in the experimen 
p and 282 pupils in the control group. The comparison of the means 
hese two groups revealed that there was no significant difference (at th 


level) between them with respect to any of the following factors 


1. Chronological age. 


2. Mental age. (Henmon—Nelson Intelligence Test) 


* Palmer O. Johnson and J. Neyman, “Tests of Certain Linear Hypotheses and 


[heir Applications to Some Educational Problems,” Statistical Research Memoirs, 
T 


Wagenen, is published by the Educational Test Bureau, Minneapolis, Minn 


ine, 1936), 72-93 


[his test, developed by Martha Kellogg, L. J. Brueckner and M. J. Van 
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3. Four abilities measured by the Analytical Scales of Attainment 

4. Reading ability. (Gates Reading Test—Ability to Read to N 
Details) 

5. Knowledge of arithmetic vocabulary studied prior to the begin 


of the experiment. 


With only one exception® the two groups were also found to 


homogencous with respect to variability on the above mentioned t 


A further study of the experimental and control groups, made » 


+} 


respect to nationality and occupation of father, revealed that on 
factors as well, the two groups were very much alike. 


The Testing and Instructional Program—One of the chief critici 
that the writer feels can be directed against many experimental studies 
that they are too far removed from the actual work done in the classro 
at the time the experiments are conducted. It was decided at the outset of 


this experiment that it would be integrated, as far as possible, with 
regular work taught during the mathematics period. The children wo 

thus come to recognize the testing and remedial program as a very defi 
part of their own class work. It was felt that this approach would prov 

greater interest in the experimental procedure, and would lead to a great 
degree of effort and cooperation on the part of the children. 

At a preliminary meeting with the teachers and the supervisor of ma 
matics, it was agreed that the experiment would extend over a period 
about 14 weeks, and that it would confine itself to the content covered 
five chapters in the text-book® which was uniformly used in all of the clas 
These chapters dealt with the following general topics: decimal fractior 


percentage, measurement, graphs and common uses of percentage. It 


decided that each teacher would follow the same order of topics, and 


these topics would be taught to the various classes, as far as possib ( 


about the same time 
The experiment was divided into three periods, each of which 
preceded and followed by tests in vocabulary and problem solving, based 


upon the material taught during the respective periods of the experin 


> 


The following are sample questions taken from the tests used: 
* The variability in mental age of the experimental group was slightly higher t 


that of the control group. 
Betz. William, Junior High School Mathematics, Book One. New York: G 


ind Company, 1933 
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Vocabulary Test: Perimeter means: (a) the amount of surface, (b) 
volume, (c) distance around, (d) distance across 
Problem Test: Find the perimeter of the rectangle whose length ts 12 
inches and whose width is 8 inches 


he 


The tests were so constructed that for each word tested in the vocabulary 


test. there was a problem in the problem test which made use of 


and 

required the understanding of that word. The above test items concern 
themselves with the word “perimeter”. Among other words, selected from 
the textbook material and incorporated in the test questions, were the fol 
lowing: receipts, balance, average, portion, area, fraction, income, successive, 
limensions, diagonal, ratio, premium, marked down, mill and quart. In all, 
60 items of vocabulary were used in the three sets of tests. 
It should be pointed out that the problems wer« constructed in such a 


manner that there was a minimum emphasis on the computational skills 


ved. Once the child understood the meaning of the critical word, and 


4 


the process of computation which it suggested, the solution of the problem 


would present no unusual difficulty. The scoring of the tests allowed no 


partial credit. Each problem was given a value of one point for the correct 
answer. 


It was felt that some value might be derived by investigating the psy 


chological principal known as the transfer of training Let it be assumed 


that the remedial exercises which were designed to bring about improvement 
in the understanding of words found in the text-book actually accomplished 
that purpose. Would there, then, be any transfer of learning to words from 
the text which were not so emphasized and clarified by the remedial exercises ? 
To study this phase of the problem, ten vocabulary items wer¢ lded to 


AU 


each of the vocabulary tests, and were designated “transfer items 
The coefficients of reliability for the tests referred to above, computed 
by the split-halves method and corrected by the Spearman-Brown formula, 
varied from .77 to .91. According to accepted practice in educational research, 
these reliabilities are high enough for group measurements, such as those 
involved in this experiment. 
"he Instructional Materials for Experimental Class The purpose 


of the practice exercises, designed for use in the experimental classes, was 
to develop a meaningful understanding of vocabulary beyond that which 
was provided by the text-book itself. The following types of exercises wer 
considered: 
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1. Daily, oral drills on selected words. 

2. Individuals use of dictionary to obtain word meanings. 

3. Use of individual notebooks, in which pupils would record mea: 
of difficult words. 
Mimeographed instructional materials and drills to supplement 
text-book. 


Whatever the treatment decided upon, it would be essential, for 
sake of unity in the experiment, to prescribe the same type, or combinat 
of types, to all of the experimental classes. Furthermore, should it be d 
able to make comparisons between classes, it would also be essential for ' 
same vocabulary to be emphasized in all classes, and as far as possible 
the same degree. 

In the light of these criteria, it seemed that mimeographed mate: 
prepared by the writer, would provide the most desirable type of rem« 
treatment. These exercises were so designed that words relating to a « 
mon topic were grouped and discussed so as to bring out their indiy 
meanings and their inter-relationships. Exercises, principally of the rc 
and matching types, accompanied each set of words, and were design: 
give a reasonable amount of drill in the use of the words. Below is a san 
of the type of exercise provided: 

Area refers to surface, and is measured in square units, such as sq 

inches, square yards, etc. 

Perimeter means distance around, and refers to length. It is measur 

in inches, feet, miles, etc. 

Volume refers to the amount of space, or contents, or capacity. | 

expressed in terms of cubic inches, cubic feet, etc. 


Exercises: Opposite each of the following, write volume, area 
perimeter, as the case may be. 
(a) 350 square feet -....------ (c) 3 square miles ~--~-- 
(d) 35 cubic inches 


Tell whether each of the following refers to volume, area 
perimeter: 


(a) amount of molding for a picture frame --~--------- 
(b) amount of wall paper for a room -------------- 
(c) length of curb stone around a city block ---~--- 
(d) amount of water in an acquarium -~--- ae 
(ce) size of a state or county 

(f) truck load of sand 
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A ditterent set of these exercises was constructed for each period of 
xperiment. Each child in every experimental class was provided with 


wn CODY The time devoted to this instruction, averaging from five to 
5 per class pet od. was taken from the regular class period 


me was allowed. The contro! classes had to rely entirely upon th 


ook and regular class discussion for their learning of these mathematical 


THE FINDINGS 

Final Status With Respect to General Learnings in Arithmetic.—It has 
ly been pointed out that at the beginning of the experiment, the experi 
d control groups were equivalent with respect to all of the abil- 
isured by the Analytical Scales of Attainment. A comparable form 
test was administered at the close of the experiment, to obtain 

es of growth in these general areas. A study of these two sets of dati 
d that significant gains were achieved during the course of the experi 
both the experimental and control groups, in all four of the areas 
tic included in this test. With respect to these gains, however, 


vere no significant differences in favor of either the experimental 


| group. 
Final Status W it! Re spect lo S pect fu Learnings in Arithmetic By 


ific learnings, reference is made to the learnings measured by the 


lary and problem tests prepared by the writer. The first comparison 
be made pertains to the scores on the three vocabulary tests. with par 


ar reference to those words which were included in the remedial 


exercises used by the experimental classes. Table I, tabulating these data, 
tes that on the first pre-test the mean scores made by the experimental 

ind control groups were 12.39 and 12.17, respectively. [hese scores reveal 
rence of .22 of a point in favor of the experimental group. In order 

this difference to be statistically significant, at the one per cent level, 
ratio of the difference to its standard error (represented in the table by 
letter k) would have to be 2.58. Since the value of k in tl 
only 1.02 


test I was not real difference, and that it might well have arisen through 


lis instance 
, it is obvious that the difference between the two groups on 
rs of random sampling. 

Similarly, it is seen from a study of Table I that the experimental and 


rol groups were statistically equivalent on the basis of the tests 


iministered before each of the remaining two periods of the experiment 
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which is statistically significant, are seen to be in favor of the experiment 
group. The greatest gains in favor of the experimental group were n 
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Control 
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AND FINAI 
RESPECT TO 
Exercises DuRING EACH PERIOD OF THE EXPERIMEN1 


TABLE | 


SCORES 


KNOWLEDGE 


(Total Score on Ez 


n x 

807 12.39 
271 12.17 
16.14 
271 13.75 
280 11.40 
247 11.79 
280 16.00 
247 13.81 
280 12.14 
245 11.86 
280 15.99 
245 14.93 


post-tests, 


ach Test 


toro 


[Vol. 38, N 


48 


OF EXPERIMENTAL AND CoN? 
OF VOCABULARY TAUGHT IN 
= 20 Points) 
Comparison of Means 

FE Diff 

1if 

147 

1 22 21 

14( 

168 2.39 219 

173 

172 244 

139 

167 2.19 217 ] 
15: 
183 + .28 240 1 
171 
165 | +1.06 237 4 


during the first and second periods of the experiment. 


Two reasons might be cited to account for the less pronounced gai 


favor of the experimental group during the last period of the experiment 


however, substantial differences, each 


In the first place, circumstances beyond the control of the experime: 


necessitated a reduction in the amount of time devoted to the reme 
exercises during the final period of the experiment. Secondly, with resp. 


to the vocabulary of the third period, dealing almost exclusively with com 
mon business uses of percentage, the text-book was quite descriptive 
complete in giving meanings and understandings. The control group, th: 
fore, had the benefit of much the same type of instruction that the exp« 
mental group received through the use of the remedial exercises. 


Gains i 


that the experimental group showed significantly greater growth than 


n Untaught Vocabulary.—Now that it has been demonstrat 


the control group in the knowledge of those words included in the remedia! 


'04 
4 
— 
4 
2.76 
270 
2.70 
2.62 
2.59 
2.87 
A 2.87 
2.59 
the 
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xercises, the question might well be asked, ‘Did similar differences arise 
th respect to other words from the text-book which were not included in 
remedial exercises?” In other words, what evidence was there of a 
nsfer of learning from taught words to untaught words? In Table II 
eans for both experimental and control groups are given on the transfer 
items for each period of the experiment. For the post-tests, as well as for 
re-tests, the differences between the means of the two groups are 


the 
h too small to be statistically significant. It seems apparent, in the face 
these facts, that in order to bring about improvement in the understand 
> of specific words, it is necessary to teach those words in a very specif 
ner. There is no evidence, at least from the results of this experiment 
i transfer of training exists in this area of learning 
TABLE II 
MPARISON OF INITIAL AND FINAL SCORES OF EXPERIMENTAL AND CONTROL 
Groups WITH RESPECT TO KNOWLEDGE OF VOCABULARY Not TAUGHT IN 
REMEDIAL EXERCISES DURING EACH PERIOD OF THE EXPERIMENT 
(Total Score on Each Test = 10 Points) 
Comparison of Means 
Test Group x |; S.D S.E Diff S. E. 
x 
| 
Exper. | 807 5.90 1.53 087 
I Pre Control 271 | 5.74 1.57 095 lf 129 1.24 
Exper. | 307 6.52 | 1.47 O84 
Post Control | 271 | 6.35 1.45 088 t 17 122 1.39 
| 
Exper. 280 | 5.91 | 1.658 094 
Il Pre Control | 247 | 5.97 1.60 102 - .06 138 13 
Exper. 280 7.42 1.67 100 
I] Post Control 247 | 7.26 1.56 100 + 16 141 1.14 
Exper. 280 | 5.73 1.89 | .083 | 
Ill Pre Control 245 5.56 1.50 | .096 | + .17 127 1.34 
Exper. | 280 7.38 1.74 104 
III Post Control | 245 7.48 1.51 097 10 142 70 


Gains in Problem Solving.—The growth of the two groups in th 
solution of problems based upon the taught vocabulary will now be con 
sidered. Table III shows that on each of the pre-tests, the differences be 
tween the groups were not large enough to be statistically significant at the 
one per cent level (all k values are less than 2.58). At the end of the first 
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and second periods, however, the differences in favor of the experin 
group, even though they were not striking, were large enough to be 
tically significant. These differences were .96 and 1.44 points, respecti 
out of a total of 20 points on each of the tests. The actual gains. how 
are somewhat less, when the initial s ; of the two groups are taken 
consideration 
TABLE III 
COMPARISON OF INITIAL AND FINAL SCORES OF EXPERIMENTAL AND CON 


Groups Wirn RESPECT TO SOLUTION OF PROBLEMS INVOLVING VOCABULA 
TAUGHT IN REMEDIAL Exercises DuRING EACH PERIOD OF THE EXPERIMENT 


(Total Score on Each Test = 20 Points) 
( iris 
Test Group D. | S.E Diff 
Exper 307 10.83 3.30 128 
I Pre Control 271 10.80 3.26 198 + 03 273 
Exper 307 12.86 3.60 205 
I Post Control 271 11.90 3.29 200 + .96 2386 3 
Exper. 280 51 3.02 181 
Il Pre Control 247 5.98 2.53 161 53 242 2 
Exper. 280 9.62 3.49 208 
Il Post Control 247 | 8.18 2.94 187 +1.44 280 
Exper. | 280 | 10.32 | 4.23 253 
III Pre Control 245 10.66 | 3.99 255 34 859 
Exper 280 14.51 8.85 | 230 | 
III Post Control 245 14.50 3.65 233 | + .01 | .827 


[he third period of the experiment did not yield results compar 
to those of the first and second periods. Even though the net gain o! 
experimental group beyond that of the control group was .35 of a | 
(from — .34 to + .01), this gain was not significant. This situatio: 
somewhat analogous to that which was observed earlier, when the 
on the vocabulary tests were discussed. It is highly possible that the 
planation given at that time for the less pronounced difference betw 
the two groups, during the third period, might also be applicable to 
present situation. 


Determination of Regions of Significance —Were the gains that w 


discovered in favor of the experimental group common to all lev 
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lity, or were they limited to pupils of certain levels of ability only? It is 
ly important to answer this question, particularly because of its 
lications in the field of remedial teaching. 
One method of obtaining the answer to this question would be to 
tify the samples, and compare means of the two groups at a series of 
lifferent levels. This would be a lengthy task, and would not under ordinary 
litions yield highly satisfactory results, particularly if the sizes of the 
ples were small. 
A technique developed by Johnson and Neyman’? can be used to solve 
problem without stratifying the samples. The application of this tech 
enables the experimenter to determine, first of all, whether or not 
ficant differences exist between two groups when they are matched sta 
illy on two basic characters, and secondly, it makes it possible to locate 
region where-in the differences are significant. 
In making this analysis, the data from the three periods of the experi 
t were combined. One investigation compared the control and experi 
groups with respect to their total gains in taught vocabulary when 
two groups were matched statistically on mental age and initial status in 
ilary. The other investigation concerned itself with a comparison of 
two groups with respect to their total gains in problem solving when 


they were matched statistically on mental age and initial status in problem 


The writer will not go into the details necessary to present the com- 
plete solutions to these two statistical problems."! The findings indicated, 
however, that the experimental group achieved significantly greater gains 
than did the control group in both vocabulary and problem solving, and that 
this superiority of the experimental group maintained for pupils of 
practically all levels of mental ability and initial status in the area 
under study. 

Other Findings.—Several other problems, inherent in or arising out 
of the major study, were also investigated. They are summarized briefly as 


Op. cit 

For the complete solution of a similar problem, the reader is referred to Robert 
H. Koenker and Carl W. Hansen, “Steps for the Application of the Johnson—Neyn 
lechnique—a Sample Analysis,” Journal of Experimental Education, X (March 1942) 
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1. A rotation study, involving four classes and two teachers, 


on concurrently with the major experiment, tended to show that 
of remedial exercises in vocabulary, of the type used in this experir 
likely to lead to increased learnings in vocabulary in whatever class 
are used. 

2. A study of gains in vocabulary and problem solving made by 
vidual classes revealed that in practically every instance where experin 
and control classes were taught by the same teacher, the greater gains 
achieved by the experimental classes. 

3. The results from the retention test administered three months 
the close of the experiment revealed the fact that the experimental 
was still statistically superior to the control group in the knowledge 
vocabulary included in the remedial exercises. During this interval, hor 
the difference between the two groups was narrowed slightly. This ct 
was brought about partly by a loss experienced by the experimental 
and partly by a small gain realized by the control group. 

4. An analysis of pupil and teacher reactions to the remedial exe: 
indicated that in the vast majority of cases, both pupils and teachers 
highly in favor of the use of these materials. Furthermore, the teachers 
also the pupils were strongly convinced that these materials were of 
siderable value in contributing to the educational growth of the pupils 

5. The efficacy of the remedial exercises employed in this experi: 
did not appear to be conditioned by the skill and personality of th 
under whose guidance and direction they were used. Favorable resu! 
achieved by teachers who were either limited in their experience or wh 
very little previous knowledge of the needs of the children they 
teaching. 


SUMMARY AND CONCLUSIONS 


The fundamental purpose of the experiment described in the prec 
paragraphs was to determine what effect specific instruction in vocal 
had on success in problem solving in seventh grade mathematics. Incid 
to this purpose, yet almost as pertinent in value, was determining the ett 
this instruction in vocabulary had on the actual learning of the vocab 
itself. The following conclusions are suggested by the findings: 

1, The use of instructional materials in mathematical vocabulary 
to significant growth in the knowledge of the specific terms includ 
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ese materials, as well as in the solution of numerical problems involving 
ise of these terms. Values derived from such study are applicable to 
s of practically all levels of ability. 

The use of vocabulary exercises of a specific nature, such as those 
loyed in this experiment, does not tend to bring about a general 
yrovement in arithmetical learnings 

There was no evidence to indicate that there is a transfer of training 

the learning of words from the text-book which are taugnt through 


¢ use of practice exercises, to the learning of other words from the text 


k which are not so taught and emphasized. 
i. The value of instructional materials such as those used in this expert 
is independent of the class in which they are used. On the whole, a 
using such materials can bring about greater growth in vocabulary 
problem solving than if she did not use them. 
5. The successful use of remedial exercises of the type used in this 
iment does not necessarily require the guidance and supervision of 
well-experienced teacher, Beneficial results can be obtained when such 
ils are handled by teachers with rather limited experience. 
6. In order to insure an adequate retention of learnings contributed 
vocabulary instructional materials, it is mecessary that they be used 


gularly and systematically as an integral part of the classroom procedure 


EDUCATIONAL IMPLICATIONS 


The educational value of a-program of study such as that organized 
d carried out in this experiment should be readily apparent to any teacher. 


[hat the values to the pupils were practical in nature and fairly permanent 


their effect, was borne out by the findings of the experiment. Greater 
ects would no doubt be observed, extending even into the general areas 
arithmetic, if such training in vocabulary were made an integral part 


»t the work in arithmetic from the time when a formal study of the subject 


s first begun. 
The writer has shown that the materials he used to bring about greate: 
wth in vocabulary, and concomitantly in problem solving, were equally 
ble to pupils of all levels of ability. Likewise, they seemed to be equally 
| in the hands of both experienced and inexperienced teachers. These 


ts should recommend a general use of similar vocabulary-building 
ises to all teachers of arithmetic. 
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An examination of any recent series of text-books in elementary a: 
metic will reveal its author's concern over the difficulties that children | 
in problem solving. Very little emphasis, however, has been placed or 
adequate building of the vocabulary of arithmetic. Only rarely will onc 
an exercise whose purpose is to test the understanding of the crucial w 
presented in the reading matter. Authors of text-books in arithmeti 
any other branch of mathematics, would do well to apply the findi: 
this experiment to future revisions of their publications. Work-booh 
signed for the sole purpose of providing tests and practice materials in 
vocabulary of arithmetic, should find a ready market. 


PROBLEMS SUGGESTED FOR FURTHER STUDY 


The following problems, arising out of the present study, might | 


profitable as subjects for further research: 


1. Would results similar to those obtained in this study be four 
vocabulary training were made an integral part of the teaching of arith 
in other grades of the school ? 

2. How far-reaching would be the benefits of vocabulary exer 
their use were extended over a period of several years? 

3. What values might be derived from other types of practice exc 
designed to build an understanding of vocabulary, such as the use « 
dictionary, the recording of meanings of important words in pupil 
books, and other forms of word study? 

4. To what extent would the study of vocabulary in science, geoxt 
history and other subjects, aid the pupil in meeting problem situations + 


arise in those areas of learning? 


FACTORS ASSOCIATED WITH SUCCESSFUL ACHIEVEMENT! 
IN PROBLEM SOLVING IN SIXTH GRADE ARITHMETIC 


CARL W. HANSEN 
Ouincy Public Schools, Quincy, Ulinois 


Editor's Note: The last twenty or twenty-five years have seen great 
gress in our understanding of the factors conditioning the learning of the 
ubjects. The author contributes to our understanding of these factors 

y relate to the learning and teaching of arithmetic. 


INTRODUCTION 


THis discussion concerns itself primarily with an analysis of certain 
s; and abilities of pupils in relation to their ability to solve verbal arith- 
problems of the kind included in standardized tests. A survey of recent 
tional literature suggests that some relationship exists between these 
ind success in solving verbal arithmetic problems. Despite the seem- 
lication of this relationship, close examination of the literature points 
1 fact that in most instances the evidence is inconclusive. Opportunities 
research in this field, are, therefore, numerous. That research is urgently 


1 is generally conceded. In fact, continuous research is essential if 
ement is to be made in such areas of arithmetic instruction as educa 
al diagnosis, remedial instruction, and curriculum revision. 

With this situation in mind the writer! endeavored to determin« 
ther certain abilities are associated with superior achievement in solving 


bal arithmetic problems. Tests? in problem solving were administered t« 


sixth grade pupils in ten communities ranging. in size from an agricul 
village of 400 inhabitants to an industrial and commercial city of 
00. After the frequency distributions for the ten communities wer: 


ind to be homogeneous with respect to variability and mean achievement, 


ey were grouped in one composite distribution which included the entire 


pul 
signated superior achievers and the lower 2 


ation. The upper 27 per cent, the 184 best problem solvers, were 


per cent, the 184 poorest 
oblem solvers, were designated inferior achievers. 


‘Hansen, Carl W. Factors Associated with Superior and Inferior Achievement in 
m Solving in Sixth Grade Arithmetic: A Statistical Analysis. Unpublished 
r's Dissertation, University of Minnesota, June 1943 

Problems Test, Analytical Scales of Attainment; Arithmetic, Division 


+ 


b. Test 14, Problems, California Test of Mental Maturity, Elementary Series 
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Since it was obviously impossible to consider all the factors sugg¢ 
as being related to successful achievement in verbal problem solving 
arithmetic, the two groups, superior and inferior achievers, were com; 


statistically on selected factors thought to be related to success in arithn 


problem solving, classified arbitrarily as follows: 


Arithmetical Factors 
Fundamental Operations 
(Quantitative Relationships (social) - 
Arithmetic Vocabulary --------- 
Estimating Answers to Problems 
Estimating Answers to Examples 
Finding the Key to a Problem 
Thinking Abstractly With Numbers 
Number 


Mental Factors 


General Reasoning Ability -- 
Noting Differences 


Note 
Non-Language Factors - 
Analogies 


Delayed Memory Span 
Immediate Memory Span 


Spacial Imagery 
Spacial Relationships - -- -- 


Inference .--- 


Reading Factors 


General Vocabulary 


Test l 
Analytical 
_Analytical S 
Analytical 

National Achievem 
_National Achiever 
National Achieves 
___-National Achiever 
____Califor 
_..Califort 


General Language Al lity Califor 
Speed-Reading to Predict Outcomes ..-----------------------=-- Gat 
Comprehension-Reading to Predict Outcomes -..------------------ Gat 
Scal Aitsinment-Arithmetic: Division 2, Form A. Minneaj 
Minn. Educational Test Bureau 
‘National Achievement Te Arithmetic Reasoning and Fundamentals (! 


> 


of Mental Maturity 


® California Test 
Test Bureau 

* Gates Silent Reading Test 
Bureau of Publications 


Center, New York. Acorn Publishing Company 
Elementary Series. Los Angeles: Calit 


Types B and D, Grades 3-8, Form 2. New Y 
leachers College, Columbia University. 


| 
j | 
__-California 
___-_-California 
G 


4 


FACTORS ASSOCIATED 


g Factor 
ating to Note Details 


prehension-Reading to Note Details 


Graphs, ¢ harts and Tables 


two groups were first compare 


est for the significance of 


yn showed that the superior 


rior group on all the fact 


group was signific: 


might be superior to the inferior grou 


age and chronological 


was necessary 


when the effects of these variables were ruled ot 


matching technique” 


However, 


» many cases are lost in matching tl 


representative of the original 


pplication of the Johnson—Neyman technique.* By use 


it is possible to test the statistical significance of the 


matched statistically on two basic characters Appl 


therefore, eliminates the 


nce in achievement between the two groups when the 


procedure. In addition, it has a f1 


- to determine the limits of the regions wherein the diff 


id inferior achiever 


ups are significant. The two grou 


herefore matched statistica 


matching criteria, m 


chronological age being controlled by 


Neyman technique. 


FACTORS IN WHICH SUPERIOR ACHIEVERS 


When the two groups were matched with the basic matching criteria 


statistical control, the superior group excelled in all except four factors 


measured by the Gates Reading Tests B and D, namely, spec 


38 Iowa Every-Pupil Test of Basic 


lary: Basic Study Skills. Bureau 


of Iowa, lowa City, Iowa 


ner O. Johnson and J. Neyn 


Application to Some Educati 


bert H. Koenkerr and Carl W. Hansen, 


Neyman Technique—A Samp! 
March 1942, 164-173 


j Test l 

‘ 

Spee Ga 

low 
The on the above factors by means 

chievers because of such variables 
| ; mental Compare the tw 
ops This can be d 

nce iat the final groups are usually no 
groups. A more satist procedut 

nger oups. A more satisfactory pro 

i 4 

tl 
he tis tec 
cation’ of the tech 

mactcnus rther advantage in that it is also de 

rences between 
basi 
and 2pplication of the Johnson 

der 
these 
| EE Skills, Grades 6, 7, and 8, Test B ot 
0cabu of Educational Research and Service, Stat 
Univesity 
‘Pl “Tests of Certain Linear Hypothes 
I em Resea M 

“Steps for the Application of the 
xX 

if 


ed in reading to note details, and comprehension in reading to not 


tails. With two ex eptions the level of significance for the adjusted d 


nce was r of the superior achievers at the one | ent level, S 
lifterently i € s th the than one h 

that a difference as lar idjusted difference could have b 
errors in mpling 


LEVEL OF SIGNIFICANCE AND AI STED DIFFEREN« BETWEEN THE MEANs 
SUPERIOR AND INFERIOR ACHIEVERS WitTH RESPECT TO THE FACTO! 
SELECTED FOR STUDY WHEN THE BASIC MATCHING CRITERIA 
HAVE BEEN STATISTICALLY CONTROLLED 


I ‘ f Ad 
ance Diff 
Arithmetical Factors 
Fundamer al (Oper ns 
mating Answers to Examy 
it g Abstract ‘ 1 2 
I's ating Answe t 
Ar i s\8 
‘ r Se 1 
Quantitative Relationships (s« 1 
Finding Key to a Problen I 
Arithmetic Vocabulary 
Mental Factors 
General Reasoning Al 
ng Differences 
Noting Likenesses - 
n-Language Factors { 
nalogies 
Tye ed Mer Spa 
Immediate Men y Spar 1 
M 
Spa I ‘ 1 
Spa Rela ine 
Infe 


Genera inguage A t l 

Reading Graphs, Charts & Tables 1 

G ul V abe y 

< i-Read Predict Ou nes 1 
Reading redict Oute 


*Ry adjusted difference is meant the difference between the means of the two groups 
effect of the basic matching criteria, Mental and Chronological Age is eliminated statistically 
ences are based on scale lues and are therefore not comparable from one factor to another. 

* Fa rachievers 


Arrangement of the factors in Table I, while arbitrary, serves to 
phasize the character of the items which are apparently most closely r 


to success in solving verbal arithmetic problems While it is not deft 


om 
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reading to predict outcomes. comprehension in reading to predict out 

Readis Factors 

Spe | 

' Comprehension-Reading to Note Details 


FACTORS ASS 


evel. A significan 


is found for sp 


hat constitutes the abi 


inder the headings 


t 


WITH ACHIEVEMENT 


lity to solve verbal arithmetic prol lems, it 1S 


} 


ent that those factors for which a significant adjusted differenc 


tant elements in that ability. In general, th 


closely associated with superior achievement appear to De thos« 
d rt 


of (1) arithmetical factors, and (2) mental 


significant adjusted difference at the one per cent level in favor 


found for two items grouped under “readin 


or acnievers Was I 
namely. general language ability, and the reading of graphs, charts 
lhe difference in general vocabulary was significant the fiv 


adjusted difference in favor of the snferi 


d in reading to predict outcomes. No significant 


was found in favor of either group for the remaining thr 


ing lack of relationship between certain reading abilities an: 


vO lary irl 
rrante¢ but two 
ynsidered, namely 


itions necessitate withholding final judgment, indica 


opiem soiving in 
n 1 easoning It 
nematicai I 


ial 


may lead to the conclusion tha 


knowledge of general vocabulary are not essen 


lamental reading skills and basic vocabulary it 
vote instructional time allotted to the 
arithmetic to abilities bearing more d 


should be pointed out that the Gates tests do 


lem solving in arithmetic, and that readin 


hmetic are specific in that field. This conclusion 


factors inherent in the original investigatio: 


(1) the predominantly verbal character of th 


ntal age, and (2) the relatively few reading an 


n relation to the whole field of reading. Whil 
tions are that 


~ 


iterials, but literary content. The relationship 


should be studied further by means of materials more definitely 


ing method 


Ouick-Scoring Mental 


Age on the achieven 


that the abilities in which the superior achievers were significant 


nder 


; designed to contribute to success are under 


part of the instructional program. Evidence presented in Table I 


‘eg 
| 
| 
5. A 

S 

ib 

. 
tems. 
em 

neral reading and gee 
b 

r success in verbal p: ae 
1 to determine mci 

iry factors consider ae 

ite 

1 the mastery of fut 

more profitable to pty 

t includ 
iatical in nature. 
Obviously success in solving arithmetic problems is more likely to Soaks 

iC 

Ors Ability Tests, Beta Test: Form A. bal 

Mental of the groups 
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better may be useful in organizing an instructional program of this 
acter. Increased emphasis should clearly be given to those listed 

shown to be related to successful achievernent in verbal problem solv 
arithmetic. For example, an instructional program intended 
through concrete experiences and well directed practice an underst 
of arithmetical processes, clear number concepts, skill in mathematical 
putation and reasoning, and basic reading skills involving the use of 
metical materials may materially reduce the number of poor achiev 
problem solving Likewise, a diagnostic procedure involving the sa 
similar factors may be employed to locate causes of disability, and, 

lowed by a proper remedial program, will likely result in greater instru 


efficiency in the teaching of verbal arithmetic problems 
REGIONS OF SIGNIFICANCI 


The Johnson—Neyman technique enables the investigator to det 
ii 


not only the specific traits for which a statistically significant d 
between good and poor achievers exists, but also to define the limits « 
population in terms of the basic matching criteria. For the sample 
the actual minimum and maximum mental ages were 88 months ( 
years) and 218 months (18-1/6 years) respectively, while the minimut 
maximum chronological ages were 120 months (10 years) and 200 1 
(16-2/3 years) respectively. Theoretical mental and chronological age 
derived by statistical analysis were in the case of some factors far in « 


of those for the actual sample. In order to avoid confusion in the mit 
the reader, the ranges in Table II are restricted to the actual mental 


chronological age limits for the sample population. 


Presentation of this type of information in tabular form invol 
definite limitation since theoretical limits derived by application of 
Johnson—Neyman technique are either elliptical or hyperbolic in nature 
presentation in tabular form requires approximations essentially quadran 
in character. The limits presented, therefore, are not exact, but show ir 
eral the mental and chronological age ranges within which pupils may 
expected to do significantly better if they are superior achievers in sol\ 


verbal arithmetic problems than if they are poor achievers. 


These data are educationally significant in that they show the age 
within which teachers may expect success in teaching those factors show: 


FACTORS ASSOCIATED WITH ACHIEVEMENT 


nificantly related to successful achievement in problem solving. For 
yf the factors the region of significance 1s very small, for instance, 
For some of the factors the data indicate that an instructional pro 
signed to develop ability in problem solving may be undertaken in 
er primary grades (lower mental age limits 88 months) while in 
of other factors (lower mental age limits 120 months or more) 
tion should, no doubt, be delayed until the later years of the ele 


y school. Similar chronological age limits can readily be noted in 


it 
TABLE II 
REGION OF SIGNIFICANCE AND APPROXIMATE MENTAL AND CHRONO 


a, AGE Limits (tN MONTHS) WITHIN WHICH THE SUPERIOR GROUP 
s SIGNIFICANTLY BETTER IN RELATION TO EACH FACTOR STUDIED 


Nature of # Appr ate Approximate 
leg of Mental ct logical 
* Signifi A ge Limits Age Limite 
cance 
Mir Max. Min Max 
metical Factors 
tal Operat 218 120 1¢ 
Answers to Examples H 123 218 i20 17 
e Problems I x8 218 120 200 
bstra h Numbe I RS 218 12 204 
Answers Problems I RR 218 120 191 
ysis F R8 218 120 170 
3 H 130 218 120 200 
e Re s (s I 107 218 120 200 
rev t Prohler E RS 148 127 161 
Voces ary I 1 200 127 137 
Mental Factors 
Reasoning Ability E RS 218 120 
Differences E 106 163 130 
ses I aba! 145 120 
Fac rs RS 202 140 
I 21 151 136 
H RR 169 136 
Mer S} RS 121 150 
H RR 15 126 
E 140 132 
ationships E RR 24 144 
E 142 146 137 
ling Factors 
I guage A I 8 218 140 2 
hs, Cl sa H 133 218 120 2 
15¢ 218 130 
1 statis a significar i f a i ers at the 1 per ce 
t for Spacial Relationships iG | Vocabula h are at the per 
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riculum revision. If an instructional program is developed which wv 


Closely related to the instructional program is the problem ot 


those factors shown to be associated with successful achievement in 
problem solving, it is evident that the curriculum must be revised accord 


Undoubtedly, it will be necessary to include within the curriculum 
ences not now generally used in connection with formal instruction 


problem solving in arithmetic. 


Further study on these factors would apps to be desirab] 


and success in solving verbal arithmetx problems Experimentation 
tical classroom situations appears necessary to reconcile the findings 
pupils following th 
procedures Dased On the eviaence cContammed In stucy 


on statistical analysis and actuai performance ol 


In\ 
tion is uf y needed on the relationship between various reading 


SIC CONSIDERATIONS FOR PROFITABLE RESEARCH 
IN ARITHMETIC! 


j \ Wi it dor | k 
+4 gt be } } i } 
t t s h on the te in f arithmetic 
le to have research on a purely academic basis, and w 
pe tiv ly Cal C cer n 0 O 
nple sible to study the errors which pupils n ke in 
O imals at upper grade levels. It is interesting to note* thal 
the errors which do occur in the division of decimals are { 


al situations’. It is interesting to note that practically every (ype of 


h can occur, does occur. It is interesting to note that d imal 
es 6—-9 inclusive, can be grouped into twenty-one ¢ assin 
lting from placing the point or shifting the point ar hig! 


ynably constant throughout these grades; that zero errors increas¢ 
nth grade level; and that all told, results are so poor as to suger st 
thing very radical should be done 
What are the possible radical pro edures? One person sugges better 


of division of decimals in the grades. Another suggests re-teaching 


ils lifferent upper erade and high school levels. But few special 
rithmetic are willing to admit that the results suggest that the tim 


he grades } heen wasted. probabl forse than 
of decimals in the ades has been wasted, prot ably worse tha 


since many children are by such teaching discouraged from goin 


in the field of mathematics 


\ recent tudy ol ctfrors in division of decimals, bases conclusion on 
‘ination with abstract numbers which suggests drill as the metho 
ching. Is drill appropriate on an example such as .51! 107.1, at th 


rade level? There are many phases of school work where drill 1 
fied. where, in fact, it the wrone method to use. What are the 


for drill? 


F. E. Grossnickl Kinds of Errors in Division of Decimals and their Con 
Jou f Ed R XXXVII, October 1943, 110 


age” 
| 
B 
( M. W1 me 
B nm Universit) 
of 
il 
| 
Vi 
th gs 
Read before a recent mecting of the Elementary Mathema Cl Boston ES 
J 
119 


‘ 
Criteria for drill may be s¢ 


1. Drill is not appropriate 


mais a process used so ott 

ixth grade level? This point w 

[t 1s not drill unless use 


} 


way only. An addition combina 


] 1 
Worl in adecimais meets 
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t up approximately as follows: 


unless the subject matter on which ma 


ndertaken, 1s d ful sO useful that it comes into actual use 
daily least very, very often. Illustrations of useful subject matt 
if g drill are beginning reading, writing legibly, spelling the basic w 
(the first 1000 or even 2000) ldition of whole numbers. Is divisior 


en as to justify attempts at mastery at 
ill be examined further 
d exactly as is. A word must be spelled 


tion has one answer only 


ne requirement for drill. 


>. If it is drill for which an examination may later be set uj; 


mastery is the only stan 


show low-grade mastery. Befor 


at any cost, the question of u 
above, must be answered. 


4. The drill load must l 


Here enters a question of educational statesmanship. How much of the t 


school time can be justly allotted to arithmetic? Certainly not more than 
one-sixth of total school time indicated by various studies of a few y 
ago (Payne, Holmes, Ayres). Since those studies, time on arithmetic 
tended to decrease, but scores in essential processes have improved. In « 
words we have in recent years applied the criterion of usefullness 
igidly, and as result have decreased the drill load. As a result ch 
have been securing better scores 

[he four criteria indicated above are sufficient, if properly applied 
tf prove tl ndertak in arithmetic. But there are other requ 


ments, the requirements of good teaching. Such requirements would 


ist that drill should not begin too soon, and that it should never be und 


ken without full and adequ: 


lard. Tests in division of decimals unifo 


i= +t 


e concluding that mastery must be at 


sefulness as raised under the first criter 


e small enough to permit perfect ma 


ite provision for meaning and motivati 


This is a full story in itself and will not be undertaken here 


lo return to decimals, how 


in datly 


process 5S are used 


@ 


Dalrymple mac 


and in periodicals. In such industries as the American Sugar Refining Con 


®* Marion Dalrymple: A Study 


Period Tex és. Master 


1933 


useful is the process of division of de 


life? Fortunately there are adequate stud 


mals, and the circumstances under which the deci 


of the Present Use f Decimals in Indu 


Thesis, Boston University, School of Educati 


| study of the uses of decimals in indust: 
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y and the Gillette Safety Razor Company she found that a large majority 
the workers had no use for decimals, that some needed a reading know! 
ioe of decimals, and that a few figured in decimals, b 


ut that this figuring 
vas highly specialized and was done by highly trained people It 


ieniy inc is im 
able that anything could have carried over to this job from work on 


mals in the grade schools. Dalrymple recommends that any tea hing of 
mals in the schools be limited to general understanding and a readin 
wledge. Her study of decimals in periodicals lead to the same conclusion 
Buckley* made an intensive study of the uses of decimals in business 

In general trade and barter, he found no decimals other than United States 
So he went to highly specialized businesses. In his study in the 
yn area, he included Chandler & Company, Forest Hills Hospit il, Otis 

| Company, Devonshire Financial Service Corporation, Burrough 


g Machine Company, United Drug Inc., and Whiting Milk Company 


Even in these highly specialized businesses, Buckley found that 76.51¢ 
employees had no uses for decimals, There were 2.36‘ 
iding knowledge of decimals. Those who computed in decimals, 21.13 


yee university work 


the total, were highly trained, many with four years of 
ineering, accounting, or hospital training. The computations were 
respective jobs. Buck 


ludes that “‘a broad reading knowledge of decimals is more neces 


than computational knowledge. Most of the decimal figuring 


lized businesses is decimalization of percentages, mostly three place 


very 
lized and for the most part were learned on 


done in 


A few, about 2.5%, need a highly technical or expert knowledge of 
Mais 


Russell’s® study of decimals is extensive enough to be authoritative. Asid 
m United States money, Russell found practically no use for 1¢ 


cimais in 


i mmon usage. So he went to big business and he cov ered the twenty-thre 
in census classifications in a study that involved eighty-nine industrial 


ants and over sixty-eight thousand employees. Of these sixty-eight thousand 
mployees, 88.2% had no uses for decimals, 4.6% needed a reading know! 


ige, and 7.4% needed to figure in decimals. Most figuring is highly special 


i Oe) Buckley: Uses of Decimals in Busine Master The Be 


School of Education, 1935 
*Garland Russell: Decimal Usage in the Occupational World. Doctor's Dis 
rtation, Boston University, 1943 
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high school 


(aside 


Decimal 


or at the college and university level. The engineering student at 
versity level may need decimals, but he carries over nothing fr h 
experience with drill on decimals, which could not have been secur 
easily and more meaningfully witho drill 

The better method for a seldom used process is appreciation. H 
has shown an appreciation unit in decimals which carried meaning tc 
grade pupils without requiring drill mastery. An appreciation un 
decimals could be centered around the history of decimals. The uni 
tion was practically the only fraction of the ancient and mediaevel w 


the common 
If. Cre 
Bel 


for 


ol 


it 


Sé 


Thus it was 


fraction, with numerators other t 


lit for the discovery of 


ne thousand years after the Hindu d 


pupils as a part of general mathematics. Decimals in any 


It 


d States money) are se used by the ordinary 


2 has been learned on t 


ing is very special figurin 


an one, finally made a 


decimal fractions goes to Simon 


4. Three decades later, Napier gave us the decimal 


ecimal system of n 


was introduced into Western Europe, before it was finally extended 


right to inciud 


unit on decim: 


tunities tor 


divisions of de 


has little or no value 


sumes too mut 
developed as 
meaning, 
to the brighter 


have real value 


* Henry Harap and C. E. Mape 


lourr 


Program 


a short appreciation unit with emphasis u 


would at least have the 


Here is the b. 


e decimal fractions for a fine ap 


IS 


pre 


ils, without any mastery requirement, but with good 
understanding The addi ion, supdtraction, 

cimals as usually taught in the intermediate or upper 


I 


and the method is not well cho 


is too frequently drill without meaning. It 


h time, en. This same 


le harm; 


on 
if 


pupils, or “those especially interested in arithmetic’, 


merit of doing litt 


>. 


il Educa R 1936), 686-693 


sight 
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ized: it has been learned on the job or yuired through special t 
Chere would be little or no carry over from work on decimals in tl 
Russell re nmends that the aecif ls in the ] ( 
high school be confined to general understanding and a reading know 
These Studies Dy Dalrym; ic, Bur kley, and Russell indicate clearly 
division of decimals ts not a proper drill assignment for grade or 


s: “Learning of Decimals in an Arithmetic Act 
XXIX (May, 


| 
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te tne prade tupils should be sen 
y requirements for decimals tor grade pupus should be, gen 
standing and a reading knowledge. There should be no drill 
and no drill examination. 
jucsuion of research in arithmetic, it ts apparent 
That not all arithmetic is drill. 

poor drill results may not always be morc 
ometimes ine abandonment ol drill should be recommended 
} 


(hat the researcher, before beginning his study, should square h 


i 


not it be t ught for rill mastery 
If it is appropriate only for problem Or appreciation te iching, should 
the drill method of checking be used? 


Considerations of drill mastery are not the only consideration 
ire broad curricular considerations. There are considerations involv 
tht teaching methods. The student who forgets entire 


rations involved in the school program is a clear illustration of the 


ly the broader 


ho redoubles his efforis after forgetting his aims 


working in the field of arithmetic have too frequently regarded 


of arithmetic as drill; they have too frequently regardc 1 drill as 


ly method of teaching arithmetic. This puts arithmetic at considerabl 
Wee need in arithmetic, as in other subjects, discriminating 
[hose who do research in the field should understand this, and 

e equally discriminating 
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m basic considerations, such as: 
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How useful ts this knowledge? babi? 
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THE MATHEMATICAL VOCABULARY USED IN SECONDARY 
SCHOOL TEXTBOOKS OF SCIENCE 


FRANCIS D. CURTIS 
University of Michigan 
Editor's Note: One function of instruction in any area is the establ 
ment of basic concepts. The author indicates some of the more important 
echoo! 


n \ | 


PUBLISHED investigations dealing with the special vocabularies of 
ranches of mathematics taught in secondary schools have been relat 
numerous during the past three decades. Prominent among such studies 
those by Pressey, Thorndike? Remers and Grant,* Georges,* and Kunk« 
The relationship between the vocabularies of mathematics and science 
however, received relatively little attention from investigators. Always 
portant, this relationship has recently taken on added significance as a tf 


4 the tormulation of pre-induction and post-induction courses and materia 


lesigned to facilitate the training of men for armed service. More evidence, 


herefore, with respect to what mathematical terms are commonly found 
textbooks of high-school science is needed both as a guide to the teacl 


f this vocabulary in the courses in mathematics taken prior to or coincid 


with those in science, and as a means of integrating more closely the wor! 


of mathematics and science in junior and senior high schools 


STATEMENT OF THE PROBLEM 


The purpose of this investigation® was to determine which ‘‘diffi 
words found in textbooks of high-school science are mathematical teri 


Pressey, Luella C. ‘The Determination of the Technical Vocabulary ot 
School Subjects,” School and Soctety, XX (July 19, 1924), 91-96 
Thorndike, E. L. The Psychology of Algebra. New York: The Macmillan ( 
Pp 260-—273 
Remmers, H. H. and Grant, A. “The Vocabulary Load of Certain Second 
School Mathematics Textbooks.” Journal of Educational Research, XVIII (Oct 


pany 


Georges, J. S. “The Nature of Difficulties Encountered in Reading Mathemati 
The Si Revieu XXXVII ( March, 1929) 217-226 

*Kunkel, Paul Vance. The Vocabulary of High School Algebra. Allerton, | 
H. Ray Haas and Company, 1939 

‘This study by Herbert Hannon is the final one in one group of 34 unpubl 
master’s theses which were completed over a number of years in the author's “Sen 
in Secondary-school Curriculum.” Hannon’s study is a synthesis and further analy 
of data from the other thirty-three theses, each of which included a word-by-w 
analysis of the entire content of one widely-used textbook of high-school science, 


124 


] 
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MATHEMATICAL VOCABULARY l 
' THE PROCEDURES AND FINDINGS 
Since no definition of a mathematical term could be found of which 
tical use could be made in this study, the first task was to prepare a set 
riteria to be used in the selection of mathematical terms. The criteria of a 
tific term which had been formulated and in successive years had been 
P d through repeated use by student-researchers in the “Seminar in 
t Teaching of Science’ at the University of Michigan, were revised by 
investigator (Hannon) with the help of a university specialist in the 
ing of mathematics. These criteria were subsequently modified as their 
rtcomings became manifest during the progress of the investigation. Th 
list which follows, though perhaps neither complete nor composed of 
ria which are in every respect mutually exclusive, proved satisfactory: 
|. A word or a phrase is considered to be a mathematical term if it 
veys to an individual trained in mathematics a connotation which it would 
onvey to a person not so trained. Ex imples: adjacent, radical, factor 
2. A word or a phrase representing a relationship which may b« 
xpres ed by means of a formula or an equation ts considered to be a mathe 
al term. Examples: pi, binomial theorem 
3. A word or an expression designating a magnitude, a quantity, or a 
er, or one having to do with the properties of form and space (as 
d in geometry) is considered to be a mathematical term. Examples 
er, area, million, perpendicular, hexagon, plane. 
1. A prefix having a mathematical connotation is considered to be of 
a mathematical term, even when attached to a root having no mathe 
, tical meaning. Examples: pent in pentoxide, mono in monobasic or in 


rail 
5. The name of a unit of measure is considered to be a mathematical 


term, but, with the exceptions stated later in this paragraph, the name of 

f which together present a study of more than five million running words con 

9 textbooks of physics, 8 of chemistry, 10 of general science, and of 

gy. Most of the studies from which Hannon secured his data provided also som 

lata which were considered earlier in the report of a synthesis of one hundred 
zations of the vocabulary of high-school science.* 


* ( urifs. Francis D Inve tigations of Ve thulary in Te vtbo bs of Science for 
ndary Schools. Boston: Ginn and Company, 1938 
I fers theses which set 1 as Irce ff data for thi tudy are those by 
George Bachur, T. F. Bartlett, C. E. Borberg, C. E. Bush, Dean Challis, C. C. Cha 
R. S. Collins, W. A. Dexter, Dorothy Dorsey, W. J. Elliott, W. I. Fiedler, C. | 
Hanshew, K. R. Houston, W. J. Hyink, H. W. Kollen, G. F. Kyser, G. I. Larkin. 
Russell McDougal, V. W. Miles, Grayson Newark, J. I. Niergarth, William Ornstein. 
H. Phipps, W. Y. Pohly, M. A. Ruisanchez, F. R. Schauer, William Schultz, R. T 
schroeder, George Spotts, W. B. Toothacker, E. J. Wearne, L. G. Wilkinson, and 
A. W. Wilson 


ix 

A 

is 

\ 

? 
_ 

if 

Vee 
7 

4 

| 

i he 

7 

Ms 

4 

=x 


126 JOURNAL OF EDUCATIONAL RESEARCH Vol. 38 


Thus volt and cand 


natical terms but voltmeter and photometer are not. Th 


Inst vents used tor measuring units used in a srtictly mathematical 


however, as yardstick, meter stick, and ruler, are considered to be m 


matical terms 


6. An expression a full comprehension of which can be gaine 
from considerable experiencing with numbers and quantities, and 
cannot be completely understood by the mere learning of a definiti 


considered to be a mathematical term Examples: ratio, equation. 


As is evident in these criteria, a mathematical term may consist of 
or more words each of which alone would have either no mathematica! 
notation or a connotation different from that of the entire expr 
Examples: inverse ratio, mixed fraction, krealest common divisor. 


} 
itt 


These criteria were applied by the investigator to the lists of “dif 
words secured from the thirty-three theses. In these investigations, a 
cult’ term was defined as one which does not occur in the first six tho 
words of Thorndike’s twenty-thousand-word list.? This definition was « 


lished from the results of 45 investigations of vocabulary difficulty en 


tered by groups of junior- and senior-high-school pupils when readin; 
books of science.® 

It will be noted that a limitation was imposed upon the present s 
by the necessity for deciding which of the words and phrases in the v 
eparate lists were mathematical terms when those words and phrase 
out of context. The impossibility of determining with assurance wl 
any one of a considerable number of these words did or did not p 
mathematical connotations in their original contexts is at once obvious 
example, table and series might or might not be mathematical terms de; 
ing on the way in which each had been used. In every such case of! 
the investigator decided arbitrarily to consider that the word was a 
matical term in order to insure that such errors as might thus be made » 
be on the side of including in the resulting lists all words which « 
defensibly be judged to be mathematical terms rather than of excluding 
terms which might logically, but could not certainly, be said t 


nathematical. 


* Thorndike, E. L. A Teacher's Word Book of the 20,000 Words Found M 
Frequently and Widely in General Reading for Children and Young Pt 
York: Bureau of Publications, Teachers College, Columbia University, 19 


"Curtis, of. cit., Chapter III 


the instrument for measuring the unit is not. i |. 
are mathemat:( 1.20 | 
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Each word or phrase thus judged by the investigator to be actually o 
1 mathematical term was listed by him and the number of tim 
m had been found in each of the thirty-three textbooks was r 
from the source studies. These terms arranged in four lists respec 
esenting the textbooks of physics, chemistry, general science, and 
} 


which the terms had originally been found, were then submitted 


ond person, trained extensively, like the investigator, in the field of 
tics. This person applied the criteria and crossed from each list every 


ohrase which, in his opinion, could not logically be considered 


be a mathematical term. The resulting four lists which now in 
y the terms approved for inclusion by both judges, were submitt 


her refinement to the university sp alist in the teaching of math 


vho had assisted the investigator in refining the criteria of a math 


This third judge in turn applied the criteria and deleted from 
nin erms all those which he thought could not justifi 


! as mathematical terms. 
le I presents data relative to the prevalence of mathem 


ry in thirty-three textbooks of science written for | ighschool pupt 


OF MATHEMATICAL TI ;INH SCHOOL TEXTBOOKS OF PHYSICS. 
CHEMISTRY, GEN! AL SCIENCE ANI BIOLoc’ 


4 
I ] Math ns 
4 
4 4 
It will be noted in Table I that much the larcest average number of 
nt dithcult mathematical terms was found in textbooks of physic 


he smallest in the textbooks of biology. It w be noted further that 
verage percentage of different difficult words that are mathematical 
n the textbooks of physics was more than four times that in the text 
of biology and more tl hat he textbook * che 

i Diology and more than twice that in the textbooks of chemustry 


general s¢ rence 
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Table II presents two ty 
portance of these mathematical terms in the study of the various bran 
of high-school science: the average frequencies with which the terms aj 


ses of evidence indicating the relatiy 


1 the terms which were found in half or 1 


in the textbooks analyzed and 
the textbooks of each branch of science. It should be kept in 
howe that many re mathematical terms than those listed tn thi ' 
ippe 1 sporadi vy in the lists of difficult words taken from the 1 
of the analyses of the thirty-three textbooks. It should also be rem 
that the terms listed in Table II are those that either appear in or a 
eventh thousand-word level of the Thorndike twenty thousand word i 


mon in the literature which Thorndike analyz 


ire not sufficiently cor 
earn places 1n that list: and that therefore the terms in Table II sh 
pplemer d with the matl ttical terms found in the first six the 
word levels of the Thorndrke I 
TABLE Il 
V1 Du ENT DIFFK MATHEMATICAL TERMS WHICH OCCURRED 
AVERAGE THREE OR More TIMES PER Book O WHICH OCCURRED IN 
HA Mor! rHE TEXTBOOKS OF PHySIcs, CHEMISTRY, 
GI At SCIFNCI AND BIOLo¢ 
( 
1* 
a 
4 
2 if 
1.1 
i I id 4 n accumulate is used on the average 3.1 
k fet ar | appeared &.5 times per bi the 6 tex 
han thre ner | k in the 9 textbooks of physics and | 
‘ : It appe d ut least ha e text s of physics, of chemistry, and of biol 
fe than half the tex cs of get al nce 
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FACTORS WHICH AFFECT THE SALARY OF HIGH SCHO¢ 
TEACHERS OF COMMERCIAL SUBJECTS IN MISSOl 


HARRY PELLE HARTKEMEIE! 


University Missourt 
Fd M t fess 1a kers | €a t 
1 
bout the f t ig to diff ces in I 
i r th if i 
tM i y Sticae analy it paper ¢ fol 
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Sex, length of employment, and size of the high school are tl 


factors which are investigated in this study of the variation in the 


paid high school teachers of commercial subjects in Missouri. It ts 


sible to study the salaries of all teachers of commercial su 


Cc 


Missouri School Directory, 1939-40, does not contain information 


schools. The return of the questionnaire sent out by the superintet 


schools for the state of Missouri is not mandatory and some questi 
were not returned at all. Furthermore the information concerning 


i 


was omitted more irequently than any otner type of information 
questionnaires that were returned. In view of this fact, the study m 
considered an analysis of a sample of the data for the whole state. W 
it is true that the data available do not constitute a strictly rando 
from the entire state, the data are quite as satisfactory as most data o 
by the questionnaire method 

Not all of the available data were used, for the statistical tc 


employed (the analysis of variance with three criteria of classification) 


quires that the fre juencies in the various classes be proportional. At 


shown in Table | 


study of all of the data available the frequencies 
decided upon. It was impossible to obtain the desired number of observa 
when the study was restricted to high school teachers who taught only 

mercial subjects, so it was necessary to include high school teachers w! 
major work is the teaching of commercial subjects. Commercial sul 
include primarily bookkeeping, typing, and shorthand, and, less freque: 


commercial arithmetic, commercial law, and business English. 


This study was restricted to first class high schools, but this is n 
serious limitation due to the fact that second and third class high 


usually do not offer commercial work. The classification labelled “lar 


132 


FACTORS WHICH AFFECT SALARY 133 


does not include schools which had thirty or more high school 


for all of these schools omitted salaries from the answers to the 


ire 


[he frequencies shown in Table I come as near to being proportional 
populations from which they were drawn as can be expected for the 

the sample selected. Actually there are slightly more than twice as 
» women commercial teachers as men. The average “tenure” of high 


ichers is between two and three years. While the frequency of 


(number of teachers) for small schools may seem too small, 


membered that many teachers in small high schools are part 
This study is concerned only with full-time teachers. 
TABLE I 
NUMBER OF OBSERVATIONS SELECTED 
Sex 
Male Female 
Size of School” : Size of School 
Small Average Large Small Average Large 
4 16 4 
4 8 2 16 1 
‘ 2 4 1 4 - 2 
2 4 1 4 8 2 
2 4 1 4 8 2 
18 36 9 36 72 18 
63 7 126 


The effect of the length of employment in the present position after 
x years is not included in this study because most regular programs of 
natic raises in salary or salary schedules end after the fifth or sixth year. 


few teachers of commercial subjects have remained in the same position 


han six years 
[he analysis of variance with three criteria of classification and propor- 


la 


li SUD-Cla 


vn in Table II 


ss {requencies was applied to the data to obtain the results 
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The variation within classes is the best measure of random var 
because it is not affected by the three principal components being st 
Sex, size of school, and length of tenure are all held constant in the m 
ment of the variation within classes. However, when the variation 
with each one of these three factors is compared with the variation 
classes, it can easily be seen that the effect of each one of the factors is | 
significant or reliable. The first three observed F ratios shown in 7 
are all much larger than the ones which would occur 1 percent of the 


due to chance alone. 


TABLE II 


ANALYSIS OF VARIANCE OF SALARIES OF MissouR! HIGH SCHOOL TEA¢ 
OF COMMERCIAL SUBJECTS 


egrees F Ra 
Source of Variation { Free- Sum of 
dom Squares Or 
ser i 
Sex 1 239, 763 239, 763 24.4 3.91 
Size of School 2 423, 056 211, 52 21.6 3. 06 
Years in Present Position 6 564, 689 112,938 | 11.5 2. 27 
Two-Wa teract 18 
Years and Size 10 240, 115 24, ( 2. 45 1. 89 
Sex and Years 6 85, 901 17, 180 1.75 2. 27 
Sex and 2 | 18, 459 9,2 
rt Way |! ra n 
Sex, Size and Years 10 151, 394 15, 139 1 4 1. 89 
Wit Classes 153 1, 501, 642 9, 815 
Total 188 3, 225, 019 


If the reader is not familiar with the use of the F ratio to test th 
nificance or reliability of the effect of a factor on a variable, the follow 
brief illustration may help.t The mean Square 239,763 is a measure of 
amount of variation in salaries caused by (or associated with) the sex of 
teacher. In order to discover whether this is a reliable value or merely 
effect of random fluctuations a statistician usually calculates the F 
This is the ratio between the measure of the effect of sex, 239,763, 
measure of the effect of purely random factors on the salaries of high sc! 


teachers of commercial subjects, The best available measure of the effe 


* For a more detailed explanation the reader should consult Snedecor, Georg 


Statistical Methods, Collegiate Pre 1938, pages 179-188, or Hartkemeier, H 


Pelle, An Introduction to Managerial Business Statistics, Thomas Y. Crowell, 


tir 

Thi 
is 
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than 
100 
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pages 25-50, ‘4 
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m fluctuations 1s provided by the amount of variation within classes, 


815. This value is a measure of the amount of variation in salaries paid a 
ip of teachers of the same sex. same size of school, and the same numbet 
f years in the present position. This procedure is adopted by the statts- 


it 


the 
ul 


in order to obtain a measure of variation free from the effect of 
principal factors he is studying. The statistician then divides the meas 
of the effect of sex by the measure of the effect of random events. In 
s case we divide 239,763 by 9,815 to obtain 24.4. If this ratio had been 
statisticians would not have been able to conclude that sex has an effect 
, salaries—that is, an attempt to compare the salaries of teachers of dif 
sexes would yield nothing more than a comparison of the salaries of 
rs of the same sex. However, we did not obtain a ratio of 1.0; we 


btain a ratio of 24.4. This shows that the variation in salaries caused 


x is 24.4 times as large as the variation in salaries caused by random 


It is extremely improbable that such a large ratio as 24.4 could occu 

to chance alone—that is, due to an unusual sample from a group of 

hers of different sexes who receive salaries that are independent of sex 

[he probability of encountering an F ratio of 24.4 due to chance alone ts 

h less than 1 percent. This 1s shown in the fact that an F ratio of 6.81 

iid not occur oftener than 1 percent of the time due to chance alone 
[his 1 percent value may be found in prepared tables of the F ratio.’ 

When any F ratio in a sample (see the observed F ratios in Table II) 

larger than the F ratio that would occur less than 5 percent of the time 

due to chance alone, statisticians accept the obse rved F ratio as reliable proof 

that the factor under consideration caused (or is associated with) a real 

ifference in the variable being studied (salary, in this case) The F ratio 

of 244 Is accepted as reliable proot that sex affects teachers’ salaries. In this 


ise the F ratio is larger than the 1 percent value, so statisticians are very 
ure (still more confident) that sex affects teachers’ salaries. If the F ratio 

been 6.81 statisticians would be right 99 times out of 100 if they were 
to say that sex affects teachers’ salaries The observed F ratio is much larger 
than 6.81, so statisticians will be right much oftener than 99 times out of 
100 if they conclude on the basis of the sample analyzed that sex does affect 


teachers’ salaries. 


* Op. cit 
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TABLE Ill 
NUMBER OF OBSERVATIONS AND AVERAGE SALARY 


Sex, Size of School 


Men Women 
18 36 4 
all $1 $91 $951 
72 108 
Average $1072 $1014 $1034 
18 2 
arge $1158 £1062 $1094 
63 126 189 
Total $1069 $994 
TABLE 
Num OF OBSERVATIONS AND AVERAGE SALARY } 
Years in Pre t Positi 
} 
Pex 
Years me t 1 tal 
M 
28 ‘ 
$1019 $931 
14 28 { 
2 $1042 S981 
28 42 
3 1084 $1004 $ 
14 21 
i 
14 21 
$1031 
7 14 1 
6 2 $1095 11 
126 
Tota $994 $1018 


A study of the averages shown in Tables III, IV, and V reveals 
on the average men are paid more than women and larger salaries are } 
by larger schools. It is not true, however, that teachers who have held 
same position for a longer period of time receive the higher salaries. Up 


and including three years, the length of time in the same position he 
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the salary: but for both sexes in all three sizes of school the teach 


who held their positions four years receive less than the teachers wh 


heir positions three years. This may be due to the fact that teachers 


un move on to better positions after two or three years do so, leaving 

wer salaries to those who cannot move. Possibly the money is used to 

the good teachers for tw r three years, and funds are insuthcient 


an them longer. In any event, the variation in salaries associated with 


in present position is significant or reliable 


{ ATION 4» \ 
S f School, Ye ] P 
\ Larg 
iz i 6 i2 
12 ‘ 49 
12 24 6 42 
3 $949 $1 $1183 $1031 
3 7 
{ $934 $ $1119 198 
6 12 21 
$947 3 
6 12 ; < 
S1158 0111 $1317 
4 If 2 9 
$951 $1094 $1019 
[he reader may say that he would have guessed that the three principal 
were important without this proof. It i 
Were ortant Wilhout Us proo Ct is 1 Oo KNOW Na 
he n | | it tl t 
eners can De provec »y quanueative analysis, ut il¢ (WO-Way 


‘ 
ion mean squares vield information that would be vé 


aimcult ) 

without the analysis of variance. It answers such questions as thes< 

1. Does the difference in salary due to sex remain constant or gradually 
h as the teacher gains experience? 


Do large and small schools discriminate against one sex to the sam«¢ 


3. Does the effect of the number of years in the present position change 


! 
n one size of school to inother 
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The last question is answered by the significant interaction® betw S 
the size of school and the number of years in present position. Valuc 
large as or larger than this one would not have arisen oftener than onc 
in a hundred due to chance alone if there were no change in the eff 
salary of years in present position as we compare different size schools. | 


ippears that larger schools are more apt to have (and use) schedule 


The small and non-significant interaction between sex and the size 
school indicates that there is no significant change in the sex discrimit 
he tting of Salaries aS WE ompare different size schools. The I 
action between sex and years is not large enough to be significant. It | } 
vides some evidence of a change in the sex discrimination when the tea 
have held the same position for a different number of years, but the obser 
interaction could have arisen due to chance alone oftener than five times 
hundred and we would have to have better evidence before we could conc! 


that time would erase the sex discrimination in salaries, 


lt d f t i y th if i 
r fact has a ca effect upon t result of ! inge 1 the s 
t! fact of is the variable (salary) is concerned. The author thinks, 


syste! itic raises 1m Salary 
cas I i 
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SOME MAJOR PROBLEMS IN EDUCATIONAL MEASUREMENT 


BENJAMIN S. BLOOM 


University of Chica 


Editor's Note: After the splurge of interest of the teens and early twen 
the measurement of educational outcomes many persons thinking that 
I b lea 1 turned theu n to new id greener pastures 
i author suggests new t area 


IN A RECENT article, A. E. Traxler* suggested certain prol lems arising 
of attempts to provide more adequate measures of some ol the less 
y measured aspects of education that seemed to him of major significance 
problems suggested by Mr. Traxler seem to the present writer to give 
nary emphasis to the mechanical aspects of testing The major problems 
entioned may be summarized as: 


1. Securing cooperation of test users in test making because (a) they 
t be “convinced that the test is sound” and (b) “the experience will help 
to appreciate the high degree of intelligence and work which goes into 
iking of a good item.” 
2. “Obtaining comparability among tests in different fields and differ 
t tests in the same field, and . . . getting test users to understand the basis 
ymparability.” 
5 Identifying the aspects of each testing area which are not highly 
rrelated, constructing long enough tests of these aspects to secure accept 
e reliability, and persuading test users to allow enough time for testing to 
rovide a dependable basis for diagnosis and guidance. 
{. Determining ‘‘the relationship of factor scores to future educational 
vocational success.” 
5. Determining “the adjustment between test booklets and answer 


The selection of these problems as the primary concern of test makers 

mes that adequate testing procedures have already been worked out, 
all that remains is further to perfect these instruments and to make 

in that consumers of tests make adequate use of them. In this case test 

kers need make only minor revisions in their tests and can devote most 
heir time to statistical studies of test results. They could strive to realize 


lream of ‘‘setting up some common national basis of reference such as 


* Traxler, Arthur E., “Problems Arising Out of the Attempt to Apply Improved 
Measurement Techniques to Education and Guidance. Journal of Educational Research, 


| 
XXVII, (September, 1943), pp. 14-18 
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the standard million’ and of the day when the results of all tests mix 
1 in ter! f norms derived from a stable group of that kind 
But, test making has not reached this millenium. We are stil 


fronted with many problems which need to be solved—problems 
indoubtedly have a higher priority rating than those listed above. 
sroblem, the problem which is most general in sc 
the incorporation of testing as an integral and intimate part of the 
learning process. Teachers too frequently regard tests as instruments 
used, results noted, and then filed permanently Standardized tests 
often regarded as devices to be used because they are educationally f 
able. Such devices are to be made by experts who utilize “high-power: 
statistics and who have other mysterious and devious methods which 
beyond the comprehension of the average teacher. 

If progress is to be made in the field of education, teachers mu 
their job clearly. They must know their own purposes and goals, they 
know when they achieve these goals, and they must know where and 
they fail. To do this, they must set up their objectives, measure initial 
of students with respect to these objectives, teach, measure final stat 


tudents, analyze results to determine success and failure; then they 


repeat the cycle over and over again, revising objectives, revising in 
tional procedures, revising measurement devices—providing a contin 
program of educational improvement. 

To strive to achieve certain objectives, the teacher himself must cl 
these goals—they must be his in every sense of the word—and they 


be stated, not to convince others, but to furnish working guides for the 
learning process. To understand an objective clearly, the teacher m 
able to express it in operational terms, in terms of student behavior an 


terms of test items. To have confidence in the measurement devices, en 


confidence to make changes on the basis of measurement results, the teach 


wust have a thorough understanding of the tests. 
Here then is the major problem for the test expert, to help teacl 
easure each of the objectives they are striving to attain, whether tang 


or intangible. 
} 


Closely bound up with the above problem, in reality a subdivision of 
is the more specific problem of identifying the major objectives of instr 
tion. This is the first step in achievement test construction. The purposes o! 


PROBLEMS IN EDUCATIONAL MEAS! 


tional institutions and of the courses which make up the educational 
ram have, for the most part, been stated in terms so general tl 
nterpret them in any 


things to all men. Each person can and does 1 


nner he pleases. As such they offer little guidance to t 
I 
aid teachers in clarifying their 


he individual 


tor or test maker. The test maker can 
tives, in stating them in terms of student behavior, in stating them in 


s of the tasks the students should be able to perform if the objective is 


e fully attained. Through several years of persistent attack on this prob 
test experts and teachers should be successful in mapping out th 


of objectives in each course of instruction now offered in our educa 
nstitutions and in stating them in such terms as to offer guidas 
who state or select them. 

As objectives of instruction are identified, test makers must aid teachet 


ng techniques for measuring their achievement or lack of 
[his is a tremendous problem and the test experts will have to invent 
techniques which extend beyond the paper and-pencil procedure S 


form such a large part of our present s 


tock in trade. Some « pecial 


involvit 


aspects of this problem are those arising from ob) 

| and social values 

instruments are made to measure each of the important objectives 
tion, the test expert and the teacher face the prol lem of sit plify 


reporting of scores and of securing the maximum use of tests an 


Its. Most test makers and users can now point to shelves and files 


ning many thousands of tests which have been administered and neatly 
and scoring and 


These tests represent many hours of construction 


thousand hours of student time. Each hour of such time should serv 


nct purpose and should be put to maximum use in educational 

lual diagnosis. Tests should be used to motivate students and instruc 

ui to guide them in various ways. We cannot justify the ministra 
test and the use of valuable student time merely t tisfy the idl 


of an individual in an educational administrative position 
Another problem which test experts must face are the many research 
yns which arise from solutions to the above problems. Educational 
h 


irch needs to be designed with the care which now characterizes r¢ 
! 


the biological and physical sciences. From such careful 


test maker should determine the effects of instruction on the relationship 


research designs, 
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between measures of various objectives. He must determine the extent 


which each of the objectives of instruction are retained, once students h 


achieved them. He should assist teachers in finding those instructional 
niques which facilitate or retard the student's progress toward the achi 
ment of various objectives. And, he should conduct research which will 
mine the various ways in which people achieve various educational go 
through maturation, through informal educational experiences, and thro 
experiences which can be described as educational only by the bro 
definition of this term. 

These are the types of problems that test makers should put first 
their priority lists if educational measurement is to develop as a prin 


element of effective education. 


| 
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DIRECTIONAL TESTS FOR EDUCATIONAL GUIDANCE 
ForREST H. KiRKPATRICK 
Bethany College, Bethany, W. Va 
Editor's Note: The war is giving new emphasis to guidance activities 
d 


The author offers certain finitions and a plea tor aptitude s that 


ire latest learning abilities 


[HERE is considerable confusion as to the use of aptitude testing in 
of different types of work or study. Part of this confusion arises be 
educational and vocational problems can hardly be differentiated, and 

use of an overlapping ol objective measures of achievement with 

iptitude. Thus, the college dean or guidance officer, influenced by 
round peg in square hole bogie” of vocational guidance, and lacking 
if conception of “educational aptitude’, may prematurely emphasize 
hoice of a career at a time when emphasis should rather be placed upon 
ilar planning appropriate to the student's particular kind of readiness 


arm. 


As an example, we may compare vocational aptitude’’ for accounting 
educational aptitude’’ for mathematical studies. Accountancy 1s an 
rable profession, offering excellent opportunities for those possessing 
butes essential to success therein. Among these is at least one phase 
iathematical ability. The same basic learning power, or educational 
ide in respect to dealing readily with figures and quantitative concepts, 
h is demanded for qualification for the C.P.A. degree, might find equal 
pe in other fields. Astronomy, actuarial work, statistical method, and 


rtain operations in physical science readily come to mind. The important 


is first to identify and cultivate mathematical aptitude where it exists 


he term aptitude itself is often so loosely employed that it must be 
defined. The accepted use of this word among students of mental 
surements is substantially that given in Warren's Dictionary of P%y- 


ry. An aptitude is there defined as a 


lition or set of characteristics regarded as symptom tic of an individual’: 
ity to acquire training in some (usually specified) knowledge, skill, o 


t of responses such as the ability to speak a language, to produce music, et 


‘ Howard C. Warren, ed., Dictionary of Psychology. New Yotk: Houghton—Mifflin 


pany, 1934. 
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Two points especially are to be noted in this definition. In the first 


apUutude ts ifterentiated trom skill okill is the ability to I SOI 

responses given time; aptitu le is the ability to lire | 
propriate conditions, regardless of whether those cond have a 
not. In the ond place, the definition does not involve any assum; 
0 } juired Or innate even 10 n it 
thes essentially the ined Dy 
Bingham in A j ind Aptitude Testing 

Within the hel embprat ed by this definition. couecves and unly 
ire I ncerne o a still more limited area, which, for conv 

may be called the area of educa 1 aj , Their concern ts i 
; ] ] ] 
ol to quit Knowled ad SK! mal 

i il i ( > i AP} 
the sting technig DC cen I rily vo on n needed 

t mai instrumet ror inst aexterity Ca re 

i ity or il ip pt ) S ire l ni 1 be issign 
to vestibul oO aining in 1 be 1 ( ons. It ; 

that aptitude t s now understood, have been utilized more ex 


by industry at tl éill level than by colleges at the higher levels 


As far as colleges are ncerned, the ultimate utilization that 1 
of students’ aptitudes, after further training in a particular field, is 
less important than is prompt recognition and development of this Ie 

pacity per It is likely that vocational guidance will take care « 


in time, if intelligent planning has laid the proper foundation for per 


yrowth and intellectual development. Narrow specialization based on 
vocational guidance is not sound. The choice of any particular occuy 
should not be pre rely or narrowly determined while the edu 
process is sul 


From this point of view, the present state of aptitude testing in co 


is far from adequate or helpful. Well validated achievement tests or 


measures of learned materials are not of any great use as aptitude ident 


and they often prove misleading. Resulting data fail to suggest any pr 


for fields of study to which a student | not been exposed. Hence, n 


the student nor the guidance officer can have a suggestion as to other 
* Bingham, Walter V., Aptitudes and Aptitude Testing. New York: Harp 
Bro s, 1937. p. 17 
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offer scope to intellectual powers of a different type. Achievement 

; throw some light on what be might have acquired under other educa- 

circumstances, or from other courses than those already experienced, 
they are neither prognostic nor analytical. 

A similar criticism might be applied to scholastic ability tests as meas- 

s of capacity to learn. It is assumed that scores on scholastic ability—or 

lligence—tests indicate the extent of one’s ability to achieve tn most ab 

fields. Such tests are supposed to measure abstract intelligence, but 

are usually validated in terms of the language-academic curriculum 


th all the limitations of usefulness that such validation implies. 


The difficulty in discovering specific and valid educational aptitudes 1s 


further aggravated by factors at work in the extra-college environment 


here is always the danger that some combination of primarily subjective 
umstances and opinions may press an individual towards some course 
study for which his mental make-up is not well suited. Often a student 
misdirected may not realize the presence of relative talents and limita- 
ns for a particular educational area until rather late for optimum develop 
In the extreme instances—which are not few—such potentialities may 
ver be explored, with some frustration rather than fruition as the result 
re is a clear need for some kind of aptitude measurements which will 
ver latent learning abilities of a specialized sort—and such abilities 
might not otherwise be discovered. We need aptitude tests that have 
rectional significance. 


There is no intention here to minimize the difficulty of fulfilling this 


need. There is very little with which to start. Yet, researc h-minded educa- 


nal psychologists who choose to meet the challenge will some day develop 


lucational aptitude tests to the degree that they have intelligence and 


lievement tests. It is likely that they will find for them equal, if not 
ater, acclaim in the field of higher education and guidance. 
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EDITORIALS 


THE SYNTHESIS OF SCIENTIFIC STUDIES 


IN THIS issue of the Journal there are included several articles on prot 
lem solving in arithmetic. They illustrate a helpful approach to the integra 
tion of research dealing with a central problem. In two of the articles 
procedure involves the comparison of results of tests administered to good 
and poor achievers in order to determine characteristic differences between 
the two groups of pupils. The traits studied in one investigation were largely 
related to the computational aspects of problem solving, while in the other 
skills related to reading were analyzed and compared. It is significant that in 
both studies traits were found in which there was not a significant difference 
between good and poor achievers while there were other elements in whi 
reliable differences were found. A synthesis of the two studies indicates that 
there was a reliable difference between the two groups in general reading 
ability but that such differences were not found when a comparison ot! 
ability was made in specific reading skills such as those measured by Gates 
Silent Reading Tests, all of which deal with the reading of literary materia 
rather than content that is essentially arithmetical and quantitative in content 
On tests of reading skills such as are involved in the solution of problem 
for example, finding the key question to a problem, or answering questior 
based on the steps in solving a problem, reliable differences between the tw 
groups were found. Similarly there was not a reliable difference betwee: 
the two groups in general information, but there was a reliable differen 
between them in their knowledge of arithmetic information such as under 
standing of social uses of number, and an appreciation of the general appli 
cation of quantitative procedures. In general there was a reliable difference 
between the two groups in various computational skills, such as estimating 
answers to examples and problems, manipulation of number operations, and 
seeing relations in number series. There were also reliable differences between 
the two groups in a variety of psychological factors, such as general reasoning 
ability, and general language ability. 
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The general conclusion to be derived from these studies is similar to 
that which has been reported by a number of other investigators of reading 
in content fields. It seems evident that the reading skills required in various 
subject-matter fields vary from one area to another. It is clear that the teacher 


arithmetic who wishes to develop ability of her pupils to solve problems 
nust see to it that the essential reading skills required are developed through 
well planned guidance. It may be assumed that if pupils who evidence weak- 
ess in problem solving are given practice in applying the skills in which 
superior pupils excel there is likely to be a considerable improvement in 
their ability to solve problems. This assumption can be established by the 
kind of experimental work reported by Johnson in one of the articles in this 
number, dealing with the improvement of arithmetic vocabulary. It should 
be pointed out that in the first two studies commented on above there were 
lifferences in the knowledge of general and arithmetic vocabulary between 
good and poor achievers, but that these were significant only at the 5 per cent 
level. Other assumptions derived from preliminary studies can be checked 
in the same way. 

Another point to which these studies make a valuable contribution is 
the determination of the areas of ability in which the use of these proce- 
dures as a basis of instruction will likely be most useful. It is obvious that 
a given technique nmay not be equally valuable for all pupils, although it may 
be of marked assistance to pupils of certain limited mental levels or chron- 
ological ages. The statistical techniques used in these three studies make 
it possible to determine the regions of significance in which there are reliable 
differences between good and poor achievers. The application of these tech- 
nical procedures to the analysis of the data made it possible to extract from 
the information a number of important conclusions that it would not have 
been possible to draw if comparisons had been made between measures of 
central tendency. The method of analysis also enabled the investigators to 
ontrol mental and chronological ages in comparing the two groups, which 
made it possible to establish regions of significance. Information of this kind 
is of great value in assisting teachers to select the kinds of instructional pro- 
cedures most likely to be of value with pupils having certain definite char- 
acteristics that are known. If it can be demonstrated by experiment that the 
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development of various skills in which good achievers excel poor achi« 
in problem solving results in improvement of that general ability, the: 


can assume that the wider use of teaching procedures based on 


techniques will lead to a general growth of pupils to solve pro 


Basic assumptions can thus be established as described above by 
liminary studies, and then they can be checked by subsequent experin 


nvestigation, 


Leo J. BRUECKNER, 
University of Minnesota 
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THE INCREASE IN PRECISION IN EDUCATIONAL AND 
PSYCHOLOGICAL EXPERIMENTATION THROUGH 
STATISTICAL CONTROLS 


[wo major statistical problems confront the research worker after he 
designed and carried out his investigation to obtain observational data 
suited to answer the question which has prompted the research. The one 

; the problem of estimation which consists in applying the method of reduc 
n which will give him the best unbiased estimate of the effect which he 
resumes to exist. The second problem is to determine whether the effect 
real one or a spurious one that may be attributable to random factors 
For this determination, application should be made of the specific test of 
gnificance appropriate to the situation. A problem associated with tests of 
nificance is the specification of the population for which a generalization 
permissible. These problems are subjects of this discussion. In the short 


ace available for their treatment, it is not possible to develop the mathe 
tical foundation upon which the statistical methods are based. The tech 
al account has been given elsewhere.? This presentation will attempt to 
wer the inquiries: (1) Why is a technique to increase precision neces- 

(2) What are the essential aspects of the technique? and (3) What 


stance does the technique give? 


It is possible, of course, and not of infrequent occurrence to carry on 
nvestigation in which no treatment that may be accorded the data will 
ad to conclusive results. Such is often the case when statistical treatment 
ind the planning of the experiment have not been considered as two aspects 
a single problem, viz., the problem of organizing or planning an inves 
tigation so as to give observations that will provide a sound basis for draw 
ng inferences with reference to the particular hypothesis under consid 
eration. It is assumed, therefore, in this discussion that, the principles, as 
they may now be known, of sound investigation have been in operation 
whether the investigation be based upon the arrangement of an experiment 
to obtain new observational data or be based upon some other systemati 7” Soe 
bservational program. It is also assumed that the research worker is not : 
guided by the belief that it is good enough if he has reason to believe that 


*Palmer O. Johnson and J. Neyman. “Tests of Certain Linear Hypotheses and 


eir Application to Some Educational Problems.” Statistical Research Memoirs. Vol. I 
pp. 57-94. Department of Statistics, University of London, University College 
June, 1936. 
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his estimate is at any rate not an underestimate or that the conventi: 


tools are sufficient because his data do not merit more refined treatm 
The implication seems to be that bad data call for bad statistics. 

The answer to the question of why a technique for increased precis 
is required may be approached by considering a common practice in educa 
tional or psychological experimentation. In order to secure uniformity 


the groups of individuals making up the subjects of an experiment, it is 
tomary to (OU) iC IMaly iduals on one Of more characters that presum 


bring about homogeneity with respect to learning abilities. While this pro 
serves to increase the sensitiveness of the experimental observations, a con 
siderable practical difficulty is met with in securing representation throu; 
out the range of variation and in discovering basic characters that bear 
sufficiently high relation to the criterion to guarantee closely homogene 
groups. Furthermore, there are usually a number of administrative gy 
that hinder or prevent freedom of selecting and placing subjects. Pairi: 
of course, may be carried out subsequent to experimentation which 
overcome administrative restrictions but not other limitations. Another 
culty is due to the fact that the difference in the mean effect of the cor 
trasted educational factors—frequently constituting the experimental fact 
under study—likely depends upon the character or characters used in 
pairing process 

Difficulties—not limited to pairing—arise also in the measurement 
the criterion itself. A frequent procedure is to estimate growth in learn 
as (1) the absolute difference between initial and final scores on the te 
or measures employed, or (2) as the percentage of gain in terms of init 
status or of a theoretical psychological limit, i.e., the total attainable scor 
In using these methods the initial and final measures are treated as if tl 
were independent and therefore the relationship usually existing is neglected 

The difficulties or limitations enumerated may be overcome or su 
stantially reduced if we seek the answers to these questions not throu 
4 prior: considerations, but in the internal evidence provided by the dat 
themselves. In this sense the experiment may be said to be self-contained 
The increase in precision of estimation of the presumed effect is, therefor 
obtained through statistical controls and is largely a regression problen 
It will be noted that if this procedure is permissible the necessity of matchu 
individuals disappears and also that the estimate of the difference in effe 
of conditions that constitute the experimental factors is no longer a rigid on 
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may be referred separately to different classes of individuals. Further- 
if the matching of individuals is unnecessary, all available individuals 
be used.? Every statistician knows how data may be falsified when an 
trary selection is made among the observational material available 
he series of investigations in the teaching of arithmetic reported in 
issue of the Journal illustrates the essential features of the statistical 
‘hod devised for solving the problems enumerated above. 
The method makes it possible to test the significance of the difference 
veen the means of groups under comparison adjusted for the inequalities 
basic characters of matching. Thus, individual pairing 1s unnecessary 
il cases can be used. 
When the null hypothesis is rejected, the method makes possible the 


truction of linear forms in the observational data which provide esti 


of the population parameters without bias and with minimum 
nces 
The method also introduces a new concept in statistical analysis, viz 
region of significance which makes it possible to answer the question 
what systems of values of the basic characters of matching would the 


erence between the adjusted means of groups of similar size be judged 


nificant at a specified level of probability if judgment is based on the 


ill 


Its of the test derived by applying the likelihood criterion? In other 
rds, by this method the expermmenter can find out (as illustrated in the 


irches reported here) for what kind of students as described by the match 


. variables a difference in the criterion exists. If the region of significance 


to be an hyperbola, for instance, then the region would consist of 


parts determining values of the basic characters for which alternatively 
one or the other of the two groups under comparison may be said to be 
perior with respect to the criterion of comparison used 


In conclusion, the technique enables the determination of the region 


ienificance, if it exists, which utilizes the measurable amount of informa 
provided by a body of observational experiences concerning the 


ypulation for which a generalization is permissible 
PALMER QO. JOHNSON 


lel ty Vl 


‘Even if matching is resorted to, increased precision can be gained by making 
wance for inequality of groups by means of th ! 
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Research Abstracts and Bibliographies 


Address research bulletins and other communications to A. S. Barr, De- 


partment of Education, University of Wisconsin, Madison 6, Wisconsin. 


ABSTRACTS 


Accrediting Military Experience. Wash 
ington, D. C.: U. S, Civil Service Com 
mission, 1944. 10 pp 


A selected list of references 


A Study of Methods of Changing Food 
Habits of Rural Children in Dakota 
County, Minnesota. Nutrition Educa- 
tion Series, Pamphlet No. 5. Washing 
ton, D. ¢ Federal Secumty Agency, 
U_ S$. Othice of Education, 1944, 18 pp 
Discusses importance of studying food 

habits; purpose of the Dakota County 

study; plan of the project; general con 
clusions; activities of the schools and ef- 
fects of food study and school lunches 


and recommendations 


BRANDON, ARTHUR L. Postwar Educa 
American Colleges and Uni- 
‘ties. Bloomington, Indiana: Ameri 
in College Publicity Association, Re 
search Division, 1944. 76 pp 
Discusses acceleration and concentra 
tion; compulsory military training in the 
colleges; veterans’ education; the postwar 
college and university; junior colleges; 
two-year bachelor’s degree; adult or con 
tinued education; college finances; schol- 
rships and loans; teachers’ salaries ; post 
war salaries; postwar enrollment; post 
war building by the colleges; cooperation 
with business and industry; and inter 
ollegiate athletics 


BrRowN, EpwIN J. and O'REILLY, 
GINIA M. A Self-Rating Scale } 
Elementary Teacher. Bulletin of 
formation, Volume XXIV, No 
poria, Kansas: Kansas State Tea 
College of Emporia, 1944. 36 pp 
The author presents a self-rating 

for elementary school teachers wit! 

on its validity and reliability. 


Bulletins of the California Test Bur 
Los Angeles, California: Calif 
Test Bureau, 1944. 

These publications discuss: cond 
high school guidance programs; plan 
the elementary school testing progr 
identifying the difficulties in learn 
arithmetic; diagnosis in the reading 
gram; appraising personality and 
adjustment; and use of tests and in 
tories in vocational guidance and 
habilitation 


CARTER, HAROLD D. Vocational Inter 
and Job Orientation. Applied Psyc 
ogy Monographs, No. 2, of the A: 
can Association for Applied Psycho 
Stanford University, California: St 
ford University Press, 1944. Pp. 85 
Discusses developmental nature of 

cational interests; the nature of the 

cepts involved; the varieties of meas 
ing instruments; the reliability and « 

stancy of interests; the validity and g 

eral usefulness of available measure 

vocational interests; special problems 


i 


| | 
I 
I 
( 
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individual differences in in 
the problem of vocational choice; 


iry and references. 


iques ; 


\MPLIN, MILDRED WILDER. Practicum 

Training for Adolescent Leadership 
Studies. Blair, 
Lutheran Publishing House, 


Hartwick College 
Nebraska 


i2. Pp. 24 


The author presents a plan for en 
ging student participation in the 


ion of social problems and issues 


NLEY, WILuIAM H., Chairman, Evalu 
in Committee. The Wright 
llege Study of Terminal 

Education. Chicago, Illinois 

junior College, 1944. 149 pp 


Junior 
General 


Wright 


Presents data on terminal education 

Wright Junior College student; evalu- 

of growth in knowledge measured 
tandardized tests; 

wth in the ability to think as meas- 
i by two tests of the Progressive Edu- 


mn Association Eight Year Study; 


ns 


evaluations of 


valuations of achievement made by means 
Chicago Junior College tests and ex 
evaluations of attitudes, in- 


rations ; 


sts, and activities; and summary, con 


ns, recommendations. 


Childhood 
Practical Suggestions for 
leaching, No. 8. New York: Bureau 
of Publications, Teachers College, 
Columbia University, 1944. 86 pp 


41G, GERALD S. Scrence in 


baéucation 


Presents a discussion on science in the 

of children; attitudes and methods 

f work to which science teaching should 

ntribute ; the elementary 

hool curriculum; and knowing and 
ng community resources 


science in 
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CURETON, THOMAS Guide for Trac- 

ing Research in the Health, Physical 
and Recreation Field Re 
printed from the Research 


Education, 


May, 1944 

Contains detailed direction on th« 
sources of material on health, physica! 
education and recreation 
EATON, MERRILL T. A Survey of the 

Achiet ement in Social Studie 10 2 


Sixth Grade Pupils in 464 Schools in 
Indiana. Bulletin of School of Educa 
tion. Indianapolis, Indiana: Bureau ot 
Cooperative Research and Field Service 
1944 Pp OS 


Indiana University, 


Presents a comparison of mean 


of various groups on age, length of 
number of 


building, size of class, number of gra 


school year, classrooms 


es 
in classroom, size of school, time given 


sta! 


to study of social studies, departmental 


ization of social studies, teaching of his 


tory and geography as unified or separat 


courses, and congressional districts 


Educational Bulletins of the Calitfornta 
Test Bureax, Hollywood Boule 


vard, Los Angeles 28, California 


5916 


No. 1. How Tests Can Improve Your 
Schools: no. 2. How To Select Test 
no. 3. How To Conduct a Survey; no. 4 


Administrative Use of Results 
no. 5. Teacher Use of Test Results; no. 6 
Basic Testing Program; no. 7. Conducting 
High School Guidance Programs; no. 5 
Planning the Elementary School Testing 
Program; no. 9. Identifying the Difficul 
ties in Learning Arithmetic; no. 10. Diag 


Survey 


nosis in the Reading Program; no. 1! 
Appraising Personality and Social Adjust 
ment; no. 12. Use of Tests and Inven 


Vocational Guidance and Re 


tories in 


habilitation; no. 13. Suggestions for the 


a 4 
st 
na 
‘a 
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ot 
in 
‘ 
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Use of Standardized Tests for Educational 
*lanning, Vocational Guidance, and Place- 


ment of Persons Committed to Correc- 
tional Institutions; no. 14. The Proper 
Use of Intelligence Tests; and no. 15 
Vocational Guidance for Junior and 


Senior High School Pupils 

Free copies of these bulletins may be 
obtained by writing to the above address 


for 


Annual 


on Metrop 


Transporta 


Providence, Rhode Island: 14 Col 

leee Street, 1944 
The Governor's Commission on Metric 
politan Transportation was formed a year 
ago to obtain the maximum of trans 


portation conservation and to maintain 
the most efficient transportation services 
for essential workers as was possible in 


wartime 


GREENLEAF, W 
Needed 
Ni 14 


security 


ALTER J. Teacher ire 
Vocational Division Leaflet, 
Washington, D. C Federal 


Agency, U. S. Office of Edu 


cation, 1944. Pp. 25 

Discusses the need for teachers: teach 
ing aS a wartime service career informa 
tion for the counselor to relay to students; 


of successful teachers; per- 
teachers; 
suitable 


interviewing teacher 


for the 


rd for prospective 


identifying characteristics for 


ective teachers: 


indidates; and suggestions 


unselor 
Heck, ARCH O. and others. Education of 
Exceptional Children and Minority 
of Educational Re- 
search, XIV, No. 3. Washington, D 
C.: National Education Association of 
the United States, 1944. Pp. 86. 


Discusses general problems and philos 


Gr up 


Review 


ophy and administration in the education 
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of exceptional children, administrat 
of special education; the mentally h: 
capped; the mentally gifted; the so 
maladjusted; the auditorily and the sy 
handicapped; the negroes; bilingual 
dren; and the Indians. 


Education 

Reconstruc 
84. Geneva, Switzer! 
of Educat 


International of 

Post-war Educational 
Bulletin No 
Internationa! 
1944. Pp. 7 
Discusses aid to educational and 


librari« Ds 


teaching staff 


Bureau 


Bureau 


tific school textbooks, f 


and post-war edu 


ernational Breau of Education, 

+ Bulletin No 
erland: International Bureau of Ed 
1943 


68. Geneva, Sv 


Pp. 37 
A summary of 


countriKe 


educational news f: 


reign 
Short 
Te Studies in Education, No 
Wellington, New Zealand: New Z 
land Council for Educational Res« 


James, T. L 


Standardizing 


1¢ «problem; examinat 
factors: wor 
of 


time-length ; 


linguistic 
measurement written s! 
“aking 


word measurement of past examinati 


quarter-minute sections; and count 


sounds 
KANDEL, I. | 
National and 
Bureau of 
lege, Columbia University, 1944. 78 ; 


Intellectual Cooperat 
New 
Publications, Teachers 


nternalionai 


Discusses education and internatio 


understanding; traditions of national « 


cation; need of a new spirit in edt 
tion: humanism and international und 


cone 
Discusses tl p 
characteristic procedur 
sonality re leneth t 
hand 
T) 
D 


‘ 


1944) 


national mentalities and inter- 


é 


ng, 
1al cooperation; education of public 
n; specialization and compartmen- 
unification of knowledge; 


tion ofr 


slace of science and technology in 
culture; learning and leadership; 
11 intellectual cooperation; and or- 


ation of intellectual cooperation 


Let. Reprint of a Harvard 
rt. Published privately by 
14, Burlington, N. C 


JAMES 
author, 
18 pp 

is a copy of the earliest written 
President of the University 
of Harvard 


arts and sciences 


ifhcer in charge the 


r school of 


WituiaMs, CAREY. What About Our 

e-American Public Affairs 

phlet. New York City: Public Af 
Committee, Inc., 1944. Pp. 31 

d on a comprehensive and fully 


lucation, 


ented study of the Japanese-Amer 


in peace and war 


IN, LAWRENCE. Radio Program Pre 
» Aids. Washington, D. C.: Fed 
Security Ageacy, U. S. Office of 


1944. 49 pp 


Presents suggestions to school and non 


n 


ERS. 


T) 


Di 


rams: and the 


nal gr 


itional radio programs; a workbook 


ups for the production of 
rms used in the production of radio 


or radio 


ar 


1 effects 


importance 


The Educatt , 
Washington, 


SAMUEL RALPH 
Ne Scie T her 


( American Council of Science 
eachers, National Education Associa 
mn, 1942. 74 pp 


n in present-day America 


edu 
the teacher 
the teacher 


person with proficiency in functional 


cusses the function of science 


individual and a citizen 
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aspects of science; the science teacher as 


a person with in functional 
ot 


for education 


proficiency 
suggested organ 
ot the 


aspects education ; 
izations science 


teacher: and inservice education 


Pr 


Bulletin 


Pre p yment Traineéé ana War 
duction Division 
No. 224, Defense Training Series No 


Vocatx ynal 


Washington, D. ¢ Federal Se 
curity Agency, U. S. Office of Educa 
tion, 1943. Pp. 88 


OLlOW-up Survcy of per 


A report of at 


sons receiving instruction in 


vocational training courses 


ment 
production workers 


in Healt 
an Relations. Harrisburg, 
Division of Health Edu 


Pr 


ea} ne 
a na Hum 


Pennsylvania 


cation, Department of Health, 1944 
PP 


A report Health 


of the fourth 


held in Pennsylvania on the scirentifx 
angle of sex education. It discusse life 
sciences as a background for health; lite 
sciences in everyday living; basic facto 

in heredity; community organization for 
health education; the official agency; how 
sex is determined; sociological conse 
quences Of Sex how far should the school 
go in teaching sex; what is the teacher's 
share of responsibility for sex education ; 


itable divisions of responsibility in sex 


equ 

education problems—parent; and equit 

able divisions of responsibility in sex 

education problems—church 

Proceedings of the Ninth Annual Guid- 
ance Conference. Studies in Higher 
Education L. Lafayette, Indiana: Di 
vision of Educational Reference, Pur 


due University, 1944. 80 pp 
A discussion on guidance for youth; 
survey of a guidance program in a sec- 


a 
By 
> Pe! 
id 
4 
ig 
a 
(es 
— 
4 
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ondary school; pre-induction training im- 
plications for guidance; the vocational 
significance of the soldier's army experi- 
ence; demobilization and readjustment of 
war workers and members of the armed 
forces; a sociographic study of a 10th- 
grade class; how society processes chil- 
ren; education and guidance of high- 
school youth in non-industrial com 


munities; and science in the schools of 


Proposals for Public Education in P 
war America. Washington, D. C.: Na 
tional Education Association, 1944 
Pp. 42 


Discusses effects of the w 


schools: desirable goals ¢ | di 
cation after the war: training and read 
justment of persons discharged from the 
armed forces or released from civilian 


occupations; personnel and cost of t 
uggested educational programs; and sum- 


ury of needed action 


Re ‘ mendatii nS or the Ip fernatt nal 


Conference on Public Education Bul- 

letin No. 86. Geneva, Switzerland: In- 

ternational Bureau of Education, 1944 

Pp. 43 

After having examined the results of 
the inquiries undertaken by the Bureau 
during the course of the year in col 
laboration with Ministries of Public In- 
struction, each of these International Con 
ferences on public education adopted “‘rec- 
ommendations” on the subjects studied, 
which were as follows: compulsory 
schooling and the raising of the school 
leaving age; admission to secondary 
schools; economies in the field of public 
education; the professional training of 


elementary school teachers the profes 
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sional training of secondary school t 
ers; councils of public instruction 
Organization of special schools; tl 
ganization of rural schools; legis 
regulating school buildings; scho 
spection; the teaching of modern 
ages; the teaching of psychology 
training of elementary and se 
school teachers; the salaries of ele: 
school teachers; the teaching of cla 
languages; the drafting, utilization 
choice of school textbooks; the sa 
of secondary school teachers; the 
ization of pre-school education; an 
teaching of geography in secon 
schools 

SEXSON, JOHN A. Our Schools Fig 

Liberty. Annual Report, 1942 

Pasadena, California: Board of fF 

tion, 1944, 

An illustrated report for the 
year, 1942-43, of the Pasadena City Hig 
School District, the Pasadena City Ju 
College District, and the Pasadena ‘ 
School District 


SIMMONS, KATHERINE. The Brash I 
dation Study of Child Growth and 
velopment; II. Physical Growth 
Development. IX, No. 1. Washingt 
D. C.: Society for Research in ¢ 
Development, National Research ¢ 
cil, 1944. 

Presents a discussion of selection 
teria; cross-sectional age-sex constants tf 
anthropometric dimensions; stat 
weight-skeletal age intercorrelations ; re 
tive growth; stature and weight self-pr 
dictability and prediction of termin 
stature; correlations of IQ with stature 
with weight and with skeletal age; ar 


selected references 


i] 


o> 
( 
tomorrow 
rg 
the 
4 
yu 
em] 
hil 


Research News and Communications 


Address all research news and communications to Carter V. Good, 
Teachers College, University of Cincinnati, Cincinnati, Ohio. 


Crucial Problems.—Florence Hale, edi- 
the Grade Teacher, 


cal issues of 1944 


of outlines six 


Need for federal and state support 
jucation, which is directly concerned 
teacher supply and demand in war- 
This situation is fully as acute as 

t year 
Not only is the financial situation 
regards teacher supply important for 
i4, but a definite effort to impress 
ers with the patriotic nature of their 
rk is needed. The high pressure cam 
gn among teachers for enlistment in 
WACS, the WAVES, has a 
ous appeal that continues to deplete 


etc., 


i 


teacher supply. 

A definite effost to have deferments 
ide in the case of badly needed men 
case should be studied definitely to 
certain that the need is there, and 
some way planned for indicating 
iblicly the fact that the man teacher is 
t evading the draft, but has been defi- 


tely 


AC 


assigned to his position as a war- 
ne service. Many men teachers hesitate 
accept deferment, because there is no 
rganized way of letting the public realize 
the situation. 

4. Much publicity directed toward dis- 
couraging women with children under 
fifteen years of age from going into any 
employment (even teaching) to the detri- 
ment of home life and the future of the 
hildren. Child psychologists have given 
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proof that, though the 
working mother provides food and shelter 
and of 
hired help, yet great harm is often done 
the by the absence of the 
mother. She is often too weary, because 


of her work, or too greatly interested in 


plenty of even 


some sort supervision, through 


to children 


outside affairs to give her little children 
sense of 


roper 


the attention and security so 


t 


s character. 


necessary to their development, 


4 


especially as regar 

5. Discouragement of a tendency to be- 
little the importance of cultural subjects 
in the school curriculum and to limit the 
instruction, particularly of children in 
rural areas, to the study of only those 
subjects concerned with securing a living 
in the particular community represented 
This objective is important and has been 
neglected. The emphasis placed by some 
columnists and radio broadcasters on the 
impracticability of cultural subjects, or 
the study of other countries, is pernicious 
Often it is so cleverly expressed that cit 
izens think 


sufficiently. If we wish a real democracy, 


it 
it 


do “not the matter through 
then we must not limit the education of 
our children to getting a living on 
certain level that is to be made permanent 
A where the children have 
only superficial knowledge of other 
countries, or where they have little of 
the cultural subjects, results in just the 
kind of a citizenship in which dictators 


rejoice, and for the elimination of which 


a 


community 


a 
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this war is being fought. Children who 
are interested only slightly beyond their 
own limited environment become eas y 
subjects for propaganda. A continued neg- 
lect of cultural subjects means a dimin- 
ished ability to think logically and to 
express oneself adequately 

6. Not so much pre-occupation in post- 
war plans as to neglect present-day foun- 
dations. Post-war education is important, 
but until we have a better idea of when 
the war will end, the major amount of 
our time as regards elementary and sec- 
ondary schools should be devoted to the 
immediate problems of keeping children 
in school, maintaining a safe and sane 
home atmosphere, and seeing that foun 
dational work is done as complete as in 
normal times, even though as motivation 
it may be centered around war activities 
and future world building. In the long 
run, this will result in the best kind of 
post-war education. A thorough ground 
ing in the regular school subjects will 
make a solid foundation upon which the 
special plans necessary to post-war work 
can be solidly built 


Extending Educational Opportunity of 
Children, Youth, and Adults —The 1944 
Yearbook of the Department of Supervi- 
sion and Curriculum Development, N. E. 
A., has appeared under the title of 
Toward a New Curriculum. Many schools 
ire initiating extensions of educational 
opportunities to mew groups of people, 
in new areas of experience, and in new 
periods of the day and year. These prac- 
tices grow out of developments in the 
current economic, political, and social 
scenes, in educational theory, and in 
changing concepts of the role of the 
school in the community. The concept 
that schooling includes more than read- 
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ing, writing, and computing has 
growing for many years. Practical r 
tic education has brought new patt 
and new forms. 

A number of publications of 
years have focused on the various fa 
of this developing pattern. By 
these new activities were regarded 
extra-curriculum, by others as pa 
fancies, and by still others as opportu 
tic educational activities, if not n 
publicity stunts. In most cases the 
vations have been unrecognized in 
true light as signs of a changing curr 
lum. The authors of the yearbook 
these changes as an extension of ed 
tional opportunity that is significant 
promising for the future of Amet 
education. They believe that this exter 
sion of education represents a new 
proach in curriculum development 

The current innovations in the curr 
lum do not follow the orderly patter: 
mass activity and assigned hours. Inst 
they disrupt the traditional prog: 
Sometimes they are not even consid 
as being related to the school curricul 
Often they involve the hours before ‘ 
and after 3:00. Saturdays, Sundays, | 
days, and the usual summer vacati 
period may be the time when these act 
vities flourish. While the program 
be planned for learners in the six 
eighteen-year age range, it is pos 
that younger as well as older members 
the community may be involved. Ti 
activities may take place in the scl 
but it is just as likely that they will o 
Thus in more than one sense they re; 
sent a new development of the curricult 

The very newness of these approach« 
means that the usual principles and prac 
tices of curriculum revision do not seen 
to fit. There are little reported experi 
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and study by other groups that can 
ised as a basis for further planning 
pioneering effort is necessary 
authors of the yearbook face 
the implications for curriculum 
implied by these changes, 
illustrations 


opment 
present a wealth of 
practice to 
jing educational opportunities to chil- 
a, youth, and adults is no peripheral 

or fad, but is, in a real 
vement toward a new curriculum 


school show that ex- 


sense, a 


[his summary was prepared by Ruth 
yningham, executive secretary of the 
artment of Supervision and Curricu 


Development 


Educatio The 
(Studies in 
describes 


earch in Higher 
ntly published report 
er Education, 1940-42 
en college investigations completed 
the auspices of the University 


nittee on Educational Research at 


niversity of Minnesota. As in 
of earlier volumes in this series, 
stigations have been financed and 
linated by this committee, which has 
furnished specialized statistical and 
sultative assistance, but the actual 
nning has been largely done by fac 
members interested in studying their 
vn curricular, personnel, and adminis 
tive problems 
Because of the many new responsibili- 
imposed on a university during war 


rs. the resources of this commit 


ing the past biennium have been de 


1 primarily to broad surveys of the 
urses offered throughout the university 
nd of faculty Sub-committees 
each of the colleges assisted in devel- 
ing suitable schedules for obtaining the 
essary data. Results from the curricu- 
m study, based on detailed information 


services 
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concerning the four thousand courses 
offered by the 
Minnesota, and summarized by T. R. Mc- 
Connell and Ruth E. Eckert, have been 


used to clarify 


currently University of 


aims of courses and cur- 


riculums and to identify undue over- 


lapping among courses, as well as areas 
in which new courses should be devel 
oped in the post-war period. In the Col 
alone, the findings 


lege of Education 


have constituted an important basis for 


dropping 28 courses, combining 66 


urses into 31, and omitting another 16 
courses. The university study of faculty 
load (reported by Ruth E. Eckert) re 
vealed the many different kinds of con 
been 


making to campus and community life. It 


tributions faculty members have 


showed, for example, that classroom 


teaching and preparation for such teach 


> 


ing normally claim only 42 per cent of 


the 55 hours that the typical faculty 


in each of the colleges devotes 


to his work, the rest of his time being 


given to such frequently unrecognized 


services as student counseling, commiutte< 
duties, 


ment of professional and lay er 


leliberations, administrative 


esearch and writing. It was also dis 


staff 


imposed a 


membership in one 
different 
f obligations than did member- 


covered that 
somewhat 
pattern 
ship in another division. On the basis of 
has been 


enabled to use its staff more efficiently 


these findings the university 
ind equitably during the emergency an 
to negotiate sensible teaching loads 


its military training programs 


Two of the remaining studies are uni 
versity- or state-wide in scope, while the 


others deal with problems that have 
arisen in particular divisions or colleges 
Included in the former 


analysis of the residence 


group are an 
and migration 
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of Minnesota college students, made in 
cooperation with the U. S. Office of 
Education and reported by Ruth E 
Eckert, and a survey of the distribution 
of financial assistance to students in the 
several colleges of the Universi-y, by 
E. G. Williamson and John D. Foley 
Important liberal-arts problems are con- 
sidered in studies of the patterns of 
courses taken by majors in various fields 
who subsequently received the B. A. de- 
gree (T. R. McConnell and Ruth E 
Eckert), the extent and character of 
student mortality (Kenneth E. Clark), 
factors related to success or failure in 
freshmen writing (Margaret E. Day), 
and the predictive values of measures 
commonly used for placing students in 
freshmen English courses (N. A. Fattu, 
Hillhouse, and E. G. William- 
son). Two of the investigations were 
made in the General College, and deal 


with the relation of study skills in the 


James T 


social studies to other measured-abilities 
(Horace T. Morse, George H. McCune, 
and Frances O. Triggs) and with the 
merits of socio-civic courses organized on 
a functional-need basis, as contrasted to 
those that adhere to the more conven- 
tional subject-matter approach (Horace 
T. Morse). The School of Business is 
represented by a study of measures pre- 
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dictive of success in its major curricy. 
lums (John G. Darley and Ralph F 
Berdie), the School of Social Work by 
an analysis of the curriculum implications 
of a recent survey of the interests, activi- 
ties and needs of social workers in 
Minnesota (Anne F. Fenlason and Ray 
mond F. Sletto), and the College of 
Pharmacy by a project involving con- 
struction and validation of comprehen. 
sive examinations (Palmer O. Johnson) 


While these are primarily 


studies, made in an effort to develop edu- 


service 


cational policies suited to the peculiar 
needs of the students, faculty, and en 
vironing community of the University of 
Minnesota, many other faculties would 
undoubtedly find some of the techniques 
distinctly valuable in attacking analogous 
problems on their own campuses. More 
over, the notably 
made at Minnesota to enlist the insights, 
enthusiasms, and talents of faculty me: 

bers in all divisions in a program of 
continuous study and self-evaluation may 


successful attempts 


well stimulate other colleges and univer- 
sities to appraise more carefully their 
own procedures and practices. 

This report was prepared by Ruth E 
Eckert, associate director of the Com- 
mittee on Educational Research. 
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